Sep 23 15:01:19 devstack cinder-volume[75097]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 15:01:19 devstack cinder-volume[75097]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 15:01:19 devstack cinder-volume[75097]: we strongly recommend against using it for new projects. Sep 23 15:01:19 devstack cinder-volume[75097]: If you are already using Eventlet, we recommend migrating to a different Sep 23 15:01:19 devstack cinder-volume[75097]: framework. For more detail see Sep 23 15:01:19 devstack cinder-volume[75097]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 15:01:19 devstack cinder-volume[75097]: import eventlet # noqa Sep 23 15:01:22 devstack cinder-volume[75097]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 15:01:22 devstack cinder-volume[75097]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 15:01:22 devstack cinder-volume[75097]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 15:01:23 devstack cinder-volume[75097]: INFO dbcounter [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Registered counter for database cinder Sep 23 15:01:23 devstack cinder-volume[75097]: DEBUG oslo_db.sqlalchemy.engines [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75097) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 15:01:23 devstack cinder-volume[75097]: DEBUG dbcounter [-] [75097] Writer thread running {{(pid=75097) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 15:01:23 devstack cinder-volume[75097]: INFO cinder.rpc [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 15:01:23 devstack cinder-volume[75097]: INFO cinder.rpc [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 15:01:23 devstack cinder-volume[75097]: DEBUG oslo_db.sqlalchemy.engines [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75097) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 15:01:23 devstack cinder-volume[75097]: INFO cinder.volume.manager [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Determined volume DB was empty at startup. Sep 23 15:01:23 devstack cinder-volume[75097]: DEBUG cinder.volume.manager [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75097) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 15:01:23 devstack cinder-volume[75097]: INFO cinder.volume.manager [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 23 15:01:23 devstack cinder-volume[75097]: WARNING stevedore.named [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 15:01:23 devstack cinder-volume[75097]: WARNING castellan.key_manager [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 15:01:23 devstack cinder-volume[75097]: WARNING cinder.keymgr.conf_key_mgr [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 15:01:23 devstack cinder-volume[75097]: DEBUG cinder.volume.drivers.lvm [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75097) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 23 15:01:23 devstack cinder-volume[75097]: DEBUG oslo_concurrency.processutils [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75097) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_concurrency.processutils [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] CMD "cinder-rtstool verify" returned: 0 in 0.430s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_db.sqlalchemy.engines [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75097) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 15:01:24 devstack cinder-volume[75097]: INFO cinder.rpc [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 23 15:01:24 devstack cinder-volume[75097]: INFO cinder.rpc [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 23 15:01:24 devstack cinder-volume[75097]: WARNING stevedore.named [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 15:01:24 devstack cinder-volume[75097]: WARNING castellan.key_manager [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 15:01:24 devstack cinder-volume[75097]: INFO cinder.volume.manager [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_db.sqlalchemy.engines [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75097) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 15:01:24 devstack cinder-volume[75097]: INFO oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Starting 1 workers Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Started child 75259 {{(pid=75097) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Full set of CONF: {{(pid=75097) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] ******************************************************************************** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Configuration options gathered from: {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] ================================================================================ {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] allow_availability_zone_fallback = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] allow_compression_on_image_upload = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75259]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] allowed_direct_url_schemes = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] api_rate_limit = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] auth_strategy = keystone {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] az_cache_duration = 3600 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_availability_zone = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_host = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_name = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_stats_polling_interval = 60 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backup_api_class = cinder.backup.api.API {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backup_name_template = backup-%s {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backup_use_same_host = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backup_use_temp_snapshot = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] chap_password = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] chap_username = {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cinder_internal_tenant_project_id = 2a925ece0aa049e383abee97a788155c {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cinder_internal_tenant_user_id = 04623572b416473cb9138f9fb1e9430f {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cloned_volume_same_az = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cluster = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] compression_format = gzip {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] compute_api_class = cinder.compute.nova.API {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] config_dir = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] config_source = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] control_exchange = openstack {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] debug = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] default_availability_zone = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] default_group_type = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] default_volume_type = lvmdriver-1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] disk_geometry = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] driver_client_cert = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] driver_client_cert_key = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] driver_data_namespace = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] driver_ssl_cert_path = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] driver_ssl_cert_verify = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] driver_use_ssl = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] enable_force_upload = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] enable_new_services = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] enable_unsupported_driver = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] enforce_multipath_for_image_xfer = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] filter_function = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] glance_api_insecure = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] glance_api_servers = ['http://192.168.122.224/image'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] glance_api_ssl_compression = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] glance_ca_certificates_file = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] glance_catalog_info = image:glance:publicURL {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] glance_certfile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] glance_keyfile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] glance_num_retries = 3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] glance_request_timeout = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] goodness_function = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] graceful_shutdown_timeout = 5 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] group_api_class = cinder.group.api.API {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] host = devstack {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] image_compress_on_upload = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] image_conversion_address_space_limit = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] image_conversion_cpu_limit = 60 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] image_conversion_disable = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] image_introspection_address_space_limit = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] image_introspection_cpu_limit = 60 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] image_upload_use_cinder_backend = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] image_upload_use_internal_tenant = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] image_volume_cache_enabled = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] image_volume_cache_max_count = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] image_volume_cache_max_size_gb = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] init_host_max_objects_retrieval = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] instance_format = [instance: %(uuid)s] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] iscsi_target_flags = {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] iscsi_write_cache = on {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] iser_helper = tgtadm {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] iser_ip_address = 192.168.122.224 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] iser_port = 3260 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] log_color = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] log_config_append = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] log_dir = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] log_file = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] log_options = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] log_rotate_interval = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] log_rotate_interval_type = days {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75259]: INFO cinder.volume.manager [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] log_rotation_type = none {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] max_age = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] max_logfile_count = 30 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] max_logfile_size_mb = 200 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] max_over_subscription_ratio = 20.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] message_reap_interval = 86400 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] message_ttl = 2592000 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] migration_create_volume_timeout_secs = 300 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] monkey_patch = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] monkey_patch_modules = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] my_ip = 192.168.122.224 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] no_snapshot_gb_quota = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] num_iser_scan_tries = 3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] num_shell_tries = 3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] num_volume_device_scan_tries = 3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] nvmeof_conn_info_version = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] nvmet_ns_id = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] nvmet_port_id = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] osapi_max_limit = 1000 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] osapi_volume_ext_list = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] osapi_volume_listen_port = 8776 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] osapi_volume_use_ssl = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] osapi_volume_workers = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] per_volume_size_limit = -1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] periodic_fuzzy_delay = 60 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] periodic_interval = 60 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] public_endpoint = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] publish_errors = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] quota_backup_gigabytes = 1000 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] quota_backups = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] quota_gigabytes = 1000 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] quota_groups = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] quota_snapshots = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] quota_volumes = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] rate_limit_burst = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] rate_limit_except_level = CRITICAL {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] rate_limit_interval = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] reinit_driver_count = 3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] replication_device = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] report_discard_supported = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] report_interval = 120 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] reservation_clean_interval = 86400 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] reservation_expire = 86400 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] reserved_image_namespaces = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] reserved_percentage = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] rpc_response_timeout = 120 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] run_external_periodic_tasks = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] scst_target_driver = iscsi {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] scst_target_iqn_name = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] service_down_time = 720 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] shell_completion = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] snapshot_name_template = snapshot-%s {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] snapshot_same_host = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] split_loggers = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] state_path = /opt/stack/data/cinder {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] storage_availability_zone = nova {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] storage_protocol = iSCSI {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] syslog_log_facility = LOG_USER {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] target_helper = lioadm {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] target_ip_address = 192.168.122.224 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] target_port = 3260 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] target_protocol = iscsi {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] target_secondary_ip_addresses = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] trace_flags = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] transport_url = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] until_refresh = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] use_chap_auth = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] use_default_quota_class = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] use_journal = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] use_json = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] use_multipath_for_image_xfer = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] use_stderr = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] use_syslog = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] verify_glance_signatures = enabled {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] volume_api_class = cinder.volume.api.API {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] volume_backend_name = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] volume_clear = zero {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] volume_clear_ionice = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] volume_clear_size = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] volume_copy_bps_limit = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] volume_dd_blocksize = 1M {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] volume_name_template = volume-%s {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] volume_service_inithost_offload = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] volume_usage_audit_period = month {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] zoning_mode = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:01:24 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:24 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_concurrency.disable_process_locking = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.auth_section = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.auth_type = password {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.auth_version = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.cache = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.certfile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.include_service_catalog = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.insecure = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.interface = public {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.keyfile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.memcache_password = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.memcache_username = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.region_name = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.service_type = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.224/identity {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.backend = dogpile.cache.null {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.backend_argument = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.backend_expiration_time = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.config_prefix = cache.oslo {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.debug_cache_backend = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.enable_retry_client = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.enable_socket_keepalive = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.enabled = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.expiration_time = 600 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.hashclient_retry_attempts = 2 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.memcache_dead_retry = 300 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.memcache_pool_maxsize = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.memcache_sasl_enabled = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.password = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.proxies = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.redis_db = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.redis_server = localhost:6379 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.retry_attempts = 2 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.retry_delay = 0.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.socket_keepalive_count = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.socket_keepalive_idle = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.socket_keepalive_interval = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.socket_timeout = 1.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.tls_allowed_ciphers = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.tls_cafile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.tls_certfile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.tls_enabled = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.tls_keyfile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cache.username = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] coordination.backend_url = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.asyncio_connection = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.asyncio_slave_connection = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.backend = sqlalchemy {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.connection = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.connection_debug = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.connection_parameters = {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.connection_recycle_time = 3600 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.connection_trace = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.db_inc_retry_interval = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.db_max_retries = 20 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.db_max_retry_interval = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.db_retry_interval = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.max_overflow = 50 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.max_pool_size = 5 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.max_retries = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.mysql_wsrep_sync_wait = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.pool_timeout = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.retry_interval = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.slave_connection = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.sqlite_synchronous = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.synchronous_reader = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] database.use_db_reconnect = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_tracing.insecure = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] profiler.connection_string = messaging:// {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] profiler.enabled = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] profiler.es_doc_type = notification {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] profiler.es_scroll_size = 10000 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] profiler.es_scroll_time = 2m {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] profiler.filter_error_trace = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] profiler.hmac_keys = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] profiler.sentinel_service_name = mymaster {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] profiler.socket_timeout = 0.1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] profiler.trace_requests = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] profiler.trace_sqlalchemy = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] profiler_jaeger.process_tags = {} {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] profiler_jaeger.service_name_prefix = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] profiler_otlp.service_name_prefix = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_policy.enforce_new_defaults = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_policy.policy_default_rule = default {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_policy.policy_file = policy.yaml {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] privsep_osbrick.group = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] privsep_osbrick.helper_command = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack sudo[75324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 23 15:01:24 devstack sudo[75324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] privsep_osbrick.user = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cinder_sys_admin.group = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cinder_sys_admin.helper_command = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] cinder_sys_admin.user = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] service_user.auth_section = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] service_user.auth_type = password {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] service_user.cafile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] service_user.certfile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] service_user.collect_timing = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] service_user.insecure = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] service_user.keyfile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] service_user.send_service_user_token = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] service_user.split_loggers = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] service_user.timeout = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] service_user.tls_ciphers = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] service_user.tls_min_version = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] glance.auth_section = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] glance.auth_type = password {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] glance.certfile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] glance.collect_timing = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] glance.insecure = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] glance.keyfile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] glance.region_name = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] glance.split_loggers = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] glance.timeout = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] glance.tls_ciphers = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] glance.tls_min_version = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.backend_availability_zone = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.chap_password = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.chap_username = {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.disk_geometry = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.driver_client_cert = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.driver_client_cert_key = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.driver_data_namespace = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.driver_use_ssl = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.extra_capabilities = {} {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.filter_function = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.goodness_function = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.iscsi_target_flags = {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.iscsi_write_cache = on {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.iser_helper = tgtadm {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.iser_ip_address = 192.168.122.224 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.iser_port = 3260 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.lvm_share_target = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.lvm_type = auto {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.num_shell_tries = 3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.replication_device = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.report_discard_supported = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.reserved_percentage = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.target_helper = tgtadm {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.target_ip_address = 192.168.122.224 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.target_port = 3260 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.target_protocol = iscsi {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.trace_flags = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.unique_fqdn_network = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.use_chap_auth = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.volume_backend_name = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.volume_clear = zero {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.volume_clear_ionice = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.volume_clear_size = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_reports.file_event_handler = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_reports.log_dir = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.backend_host = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.chap_password = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.chap_username = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.disk_geometry = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.driver_client_cert = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.extra_capabilities = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.filter_function = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.goodness_function = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.iser_helper = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.iser_ip_address = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.iser_port = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.lvm_share_target = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.lvm_type = auto {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.num_shell_tries = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.replication_device = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.report_discard_supported = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.reserved_percentage = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.scst_target_driver = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.storage_protocol = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.target_helper = lioadm {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.target_ip_address = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.target_port = 3260 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.trace_flags = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.use_chap_auth = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.volume_clear = zero {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.volume_clear_size = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] lvmdriver-1.volumes_dir = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.ssl = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_notifications.driver = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_notifications.retry = -1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] key_manager.fixed_key = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican.barbican_api_version = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican.barbican_endpoint = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican.barbican_endpoint_type = public {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican.barbican_region_name = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican.cafile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican.certfile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican.collect_timing = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican.insecure = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican.keyfile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican.number_of_retries = 60 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican.retry_delay = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican.send_service_user_token = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican.split_loggers = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican.timeout = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican.tls_ciphers = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican.tls_min_version = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican.verify_ssl = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican.verify_ssl_path = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican_service_user.auth_section = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican_service_user.auth_type = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican_service_user.cafile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican_service_user.certfile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican_service_user.collect_timing = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican_service_user.insecure = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican_service_user.keyfile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican_service_user.split_loggers = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican_service_user.timeout = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican_service_user.tls_ciphers = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] barbican_service_user.tls_min_version = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] vault.approle_role_id = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] vault.approle_secret_id = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] vault.auth_method = approle {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] vault.auth_path = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] vault.kv_mountpoint = secret {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] vault.kv_path = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] vault.kv_version = 2 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] vault.namespace = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] vault.root_token_id = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] vault.ssl_ca_crt_file = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] vault.timeout = 60.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] vault.token_file = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] vault.token_role = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] vault.use_ssl = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:01:24 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] ******************************************************************************** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 15:01:24 devstack sudo[75324]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:24 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:24 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:24 devstack sudo[75447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 15:01:24 devstack sudo[75447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:25 devstack sudo[75447]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:25 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.246s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:25 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:01:25 devstack cinder-volume[75259]: INFO cinder.brick.local_dev.lvm [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 23 15:01:25 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:25 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:25 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:25 devstack sudo[75542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 15:01:25 devstack sudo[75542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:25 devstack sudo[75542]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:25 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:25 devstack cinder-volume[75259]: DEBUG cinder.brick.local_dev.lvm [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75259) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 23 15:01:25 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:25 devstack sudo[75629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 15:01:25 devstack sudo[75629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:25 devstack sudo[75629]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:25 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.565s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:25 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:25 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:25 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:25 devstack sudo[75860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 15:01:25 devstack sudo[75860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:26 devstack sudo[75860]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:26 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:26 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:26 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:26 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:26 devstack sudo[75864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 23 15:01:26 devstack sudo[75864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:26 devstack sudo[75864]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:26 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.299s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:26 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:26 devstack sudo[75947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 15:01:26 devstack sudo[75947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:26 devstack sudo[75947]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:26 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:26 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:26 devstack sudo[75950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 15:01:26 devstack sudo[75950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:27 devstack sudo[75950]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:27 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.341s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:27 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:27 devstack sudo[76035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 15:01:27 devstack sudo[76035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:27 devstack sudo[76035]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:27 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:27 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:27 devstack sudo[76042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 15:01:27 devstack sudo[76042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:27 devstack sudo[76042]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:27 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:27 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:27 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:27 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:27 devstack sudo[76046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 15:01:27 devstack sudo[76046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:28 devstack sudo[76046]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:28 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:28 devstack cinder-volume[75259]: INFO cinder.volume.drivers.lvm [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 23 15:01:28 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:28 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:28 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:28 devstack sudo[76050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 15:01:28 devstack sudo[76050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:28 devstack sudo[76050]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:28 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:28 devstack cinder-volume[75259]: DEBUG cinder.volume.drivers.lvm [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Updating volume stats {{(pid=75259) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 15:01:28 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:28 devstack sudo[76057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 15:01:28 devstack sudo[76057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:28 devstack sudo[76057]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:28 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:28 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:28 devstack sudo[76062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 15:01:28 devstack sudo[76062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:28 devstack sudo[76062]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:28 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:28 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:28 devstack sudo[76065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 15:01:28 devstack sudo[76065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:29 devstack sudo[76065]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:29 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:29 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:29 devstack sudo[76069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 15:01:29 devstack sudo[76069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:29 devstack sudo[76069]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:29 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:29 devstack cinder-volume[75259]: INFO cinder.volume.driver [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Driver hasn't implemented _init_vendor_properties() Sep 23 15:01:29 devstack cinder-volume[75259]: DEBUG cinder.volume.driver [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75259) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 15:01:29 devstack cinder-volume[75259]: DEBUG oslo_db.sqlalchemy.engines [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75259) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 15:01:29 devstack cinder-volume[75259]: DEBUG dbcounter [-] [75259] Writer thread running {{(pid=75259) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 15:01:29 devstack cinder-volume[75259]: DEBUG cinder.db.api [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Building query based on filter {{(pid=75259) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 23 15:01:29 devstack cinder-volume[75259]: DEBUG cinder.image.image_utils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75259) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 15:01:29 devstack cinder-volume[75259]: INFO cinder.keymgr.migration [None req-07dc1306-7a47-40c5-919a-0a5903faac15 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 15:01:29 devstack cinder-volume[75259]: DEBUG cinder.volume.drivers.lvm [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Updating volume stats {{(pid=75259) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 15:01:29 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:29 devstack sudo[76074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 15:01:29 devstack sudo[76074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:29 devstack sudo[76074]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:29 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:29 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:29 devstack sudo[76077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 15:01:29 devstack sudo[76077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:30 devstack sudo[76077]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:30 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:30 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:30 devstack sudo[76080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 15:01:30 devstack sudo[76080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:30 devstack sudo[76080]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:30 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:30 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:30 devstack sudo[76083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 15:01:30 devstack sudo[76083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:30 devstack sudo[76083]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:30 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:30 devstack cinder-volume[75259]: DEBUG cinder.manager [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Notifying Schedulers of capabilities ... {{(pid=75259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:01:30 devstack cinder-volume[75259]: INFO cinder.volume.manager [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Driver initialization completed successfully. Sep 23 15:01:30 devstack cinder-volume[75259]: INFO cinder.manager [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Initiating service 2 cleanup Sep 23 15:01:30 devstack cinder-volume[75259]: INFO cinder.manager [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Service 2 cleanup completed. Sep 23 15:01:30 devstack cinder-volume[75259]: DEBUG cinder.service [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Creating RPC server for service cinder-volume {{(pid=75259) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 15:01:30 devstack cinder-volume[75259]: DEBUG cinder.service [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75259) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 15:01:30 devstack cinder-volume[75259]: INFO cinder.volume.manager [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 23 15:01:30 devstack cinder-volume[75259]: DEBUG cinder.volume.drivers.lvm [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Updating volume stats {{(pid=75259) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 15:01:30 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:30 devstack sudo[76088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 15:01:30 devstack sudo[76088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:31 devstack sudo[76088]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:31 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:31 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:31 devstack sudo[76091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 15:01:31 devstack sudo[76091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:31 devstack sudo[76091]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:31 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:31 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:31 devstack sudo[76094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 15:01:31 devstack sudo[76094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:31 devstack sudo[76094]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:31 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:31 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:01:31 devstack sudo[76100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 15:01:31 devstack sudo[76100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:01:32 devstack sudo[76100]: pam_unix(sudo:session): session closed for user root Sep 23 15:01:32 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:01:32 devstack cinder-volume[75259]: INFO cinder.volume.manager [None req-b5432740-c3cd-442f-a75c-96e9509bcb5e None None] Driver post RPC initialization completed successfully. Sep 23 15:01:34 devstack cinder-volume[75097]: DEBUG dbcounter [-] [75097] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75097) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:01:37 devstack cinder-volume[75259]: DEBUG oslo_service.periodic_task [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running periodic task VolumeManager._thread_info {{(pid=75259) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:01:37 devstack cinder-volume[75259]: DEBUG cinder.volume.manager [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] thread count: 6 {{(pid=75259) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:01:37 devstack cinder-volume[75259]: DEBUG cinder.volume.manager [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] thread info: [<_MainThread(MainThread, started 135652841414784)>, , , , , ] {{(pid=75259) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:01:42 devstack cinder-volume[75259]: DEBUG dbcounter [-] [75259] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75259) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:01:42 devstack cinder-volume[75259]: DEBUG dbcounter [-] [75259] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75259) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:02:37 devstack cinder-volume[75259]: DEBUG oslo_service.periodic_task [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75259) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:02:37 devstack cinder-volume[75259]: DEBUG cinder.volume.drivers.lvm [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Updating volume stats {{(pid=75259) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 15:02:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:02:37 devstack sudo[78155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 15:02:37 devstack sudo[78155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:02:37 devstack sudo[78155]: pam_unix(sudo:session): session closed for user root Sep 23 15:02:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:02:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:02:37 devstack sudo[78169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 15:02:37 devstack sudo[78169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:02:37 devstack sudo[78169]: pam_unix(sudo:session): session closed for user root Sep 23 15:02:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:02:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:02:37 devstack sudo[78179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 15:02:37 devstack sudo[78179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:02:37 devstack sudo[78179]: pam_unix(sudo:session): session closed for user root Sep 23 15:02:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:02:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:02:37 devstack sudo[78182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 15:02:37 devstack sudo[78182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:02:38 devstack sudo[78182]: pam_unix(sudo:session): session closed for user root Sep 23 15:02:38 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:02:38 devstack cinder-volume[75259]: DEBUG cinder.manager [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Notifying Schedulers of capabilities ... {{(pid=75259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:02:38 devstack cinder-volume[75259]: DEBUG oslo_service.periodic_task [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running periodic task VolumeManager._thread_info {{(pid=75259) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:02:38 devstack cinder-volume[75259]: DEBUG cinder.volume.manager [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] thread count: 6 {{(pid=75259) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:02:38 devstack cinder-volume[75259]: DEBUG cinder.volume.manager [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] thread info: [<_MainThread(MainThread, started 135652841414784)>, , , , , ] {{(pid=75259) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:03:37 devstack cinder-volume[75259]: DEBUG oslo_service.periodic_task [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75259) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:03:37 devstack cinder-volume[75259]: DEBUG cinder.volume.drivers.lvm [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Updating volume stats {{(pid=75259) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 15:03:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:03:37 devstack sudo[81541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 15:03:37 devstack sudo[81541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:03:37 devstack sudo[81541]: pam_unix(sudo:session): session closed for user root Sep 23 15:03:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:03:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:03:37 devstack sudo[81544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 15:03:37 devstack sudo[81544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:03:37 devstack sudo[81544]: pam_unix(sudo:session): session closed for user root Sep 23 15:03:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:03:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:03:37 devstack sudo[81551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 15:03:37 devstack sudo[81551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:03:37 devstack sudo[81551]: pam_unix(sudo:session): session closed for user root Sep 23 15:03:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:03:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:03:37 devstack sudo[81555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 15:03:37 devstack sudo[81555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:03:38 devstack sudo[81555]: pam_unix(sudo:session): session closed for user root Sep 23 15:03:38 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:03:38 devstack cinder-volume[75259]: DEBUG cinder.manager [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Notifying Schedulers of capabilities ... {{(pid=75259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:03:42 devstack cinder-volume[75259]: DEBUG dbcounter [-] [75259] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75259) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:04:37 devstack cinder-volume[75259]: DEBUG oslo_service.periodic_task [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75259) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:04:37 devstack cinder-volume[75259]: DEBUG cinder.volume.drivers.lvm [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Updating volume stats {{(pid=75259) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 15:04:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:04:37 devstack sudo[83594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 15:04:37 devstack sudo[83594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:04:37 devstack sudo[83594]: pam_unix(sudo:session): session closed for user root Sep 23 15:04:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:04:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:04:37 devstack sudo[83608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 15:04:37 devstack sudo[83608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:04:37 devstack sudo[83608]: pam_unix(sudo:session): session closed for user root Sep 23 15:04:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:04:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:04:37 devstack sudo[83611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 15:04:37 devstack sudo[83611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:04:37 devstack sudo[83611]: pam_unix(sudo:session): session closed for user root Sep 23 15:04:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:04:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:04:37 devstack sudo[83614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 15:04:37 devstack sudo[83614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:04:38 devstack sudo[83614]: pam_unix(sudo:session): session closed for user root Sep 23 15:04:38 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:04:38 devstack cinder-volume[75259]: DEBUG cinder.manager [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Notifying Schedulers of capabilities ... {{(pid=75259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:04:38 devstack cinder-volume[75259]: DEBUG oslo_service.periodic_task [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running periodic task VolumeManager._thread_info {{(pid=75259) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:04:38 devstack cinder-volume[75259]: DEBUG cinder.volume.manager [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] thread count: 6 {{(pid=75259) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:04:38 devstack cinder-volume[75259]: DEBUG cinder.volume.manager [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] thread info: [<_MainThread(MainThread, started 135652841414784)>, , , , , ] {{(pid=75259) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:05:37 devstack cinder-volume[75259]: DEBUG oslo_service.periodic_task [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75259) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:05:37 devstack cinder-volume[75259]: DEBUG cinder.volume.drivers.lvm [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Updating volume stats {{(pid=75259) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 15:05:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:05:37 devstack sudo[84823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 15:05:37 devstack sudo[84823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:05:37 devstack sudo[84823]: pam_unix(sudo:session): session closed for user root Sep 23 15:05:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:05:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:05:37 devstack sudo[84826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 15:05:37 devstack sudo[84826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:05:37 devstack sudo[84826]: pam_unix(sudo:session): session closed for user root Sep 23 15:05:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:05:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:05:37 devstack sudo[84830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 15:05:37 devstack sudo[84830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:05:37 devstack sudo[84830]: pam_unix(sudo:session): session closed for user root Sep 23 15:05:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:05:37 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:05:37 devstack sudo[84833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 15:05:37 devstack sudo[84833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:05:38 devstack sudo[84833]: pam_unix(sudo:session): session closed for user root Sep 23 15:05:38 devstack cinder-volume[75259]: DEBUG oslo_concurrency.processutils [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:05:38 devstack cinder-volume[75259]: DEBUG cinder.manager [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Notifying Schedulers of capabilities ... {{(pid=75259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:05:38 devstack cinder-volume[75259]: DEBUG oslo_service.periodic_task [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] Running periodic task VolumeManager._thread_info {{(pid=75259) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:05:38 devstack cinder-volume[75259]: DEBUG cinder.volume.manager [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] thread count: 6 {{(pid=75259) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:05:38 devstack cinder-volume[75259]: DEBUG cinder.volume.manager [None req-3e6eff6d-234d-4e18-ba5e-7d64109dcb5a None None] thread info: [<_MainThread(MainThread, started 135652841414784)>, , , , , ] {{(pid=75259) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:05:42 devstack cinder-volume[75259]: DEBUG dbcounter [-] [75259] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75259) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:05:50 devstack cinder-volume[75097]: INFO oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Caught SIGTERM, stopping children Sep 23 15:05:50 devstack cinder-volume[75097]: DEBUG oslo_concurrency.lockutils [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Acquiring lock "singleton_lock" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 15:05:50 devstack cinder-volume[75097]: DEBUG oslo_concurrency.lockutils [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Acquired lock "singleton_lock" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 15:05:50 devstack cinder-volume[75097]: DEBUG oslo_concurrency.lockutils [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Releasing lock "singleton_lock" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 15:05:50 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Stop services. {{(pid=75097) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 23 15:05:50 devstack cinder-volume[75097]: DEBUG oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Killing children. {{(pid=75097) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 23 15:05:50 devstack cinder-volume[75097]: INFO oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Waiting on 1 children to exit Sep 23 15:05:50 devstack cinder-volume[75259]: DEBUG oslo_concurrency.lockutils [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Acquiring lock "singleton_lock" {{(pid=75259) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 15:05:50 devstack cinder-volume[75259]: DEBUG oslo_concurrency.lockutils [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Acquired lock "singleton_lock" {{(pid=75259) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 15:05:50 devstack cinder-volume[75259]: DEBUG oslo_concurrency.lockutils [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Releasing lock "singleton_lock" {{(pid=75259) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 15:05:50 devstack cinder-volume[75259]: WARNING amqp [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 15:05:50 devstack cinder-volume[75259]: WARNING amqp [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 15:05:50 devstack cinder-volume[75097]: INFO oslo_service.backend._eventlet.service [None req-222cdfec-736e-4fe3-ae18-e71f0a8ed921 None None] Child 75259 exited with status 0 Sep 23 15:05:51 devstack cinder-volume[85245]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 15:05:51 devstack cinder-volume[85245]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 15:05:51 devstack cinder-volume[85245]: we strongly recommend against using it for new projects. Sep 23 15:05:51 devstack cinder-volume[85245]: If you are already using Eventlet, we recommend migrating to a different Sep 23 15:05:51 devstack cinder-volume[85245]: framework. For more detail see Sep 23 15:05:51 devstack cinder-volume[85245]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 15:05:51 devstack cinder-volume[85245]: import eventlet # noqa Sep 23 15:05:53 devstack cinder-volume[85245]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 15:05:53 devstack cinder-volume[85245]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 15:05:53 devstack cinder-volume[85245]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 15:05:54 devstack cinder-volume[85245]: INFO dbcounter [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Registered counter for database cinder Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_db.sqlalchemy.engines [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85245) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG dbcounter [-] [85245] Writer thread running {{(pid=85245) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 15:05:54 devstack cinder-volume[85245]: INFO cinder.rpc [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 15:05:54 devstack cinder-volume[85245]: INFO cinder.rpc [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_db.sqlalchemy.engines [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85245) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 15:05:54 devstack cinder-volume[85245]: INFO cinder.volume.manager [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Determined volume DB was empty at startup. Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG cinder.volume.manager [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85245) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 15:05:54 devstack cinder-volume[85245]: INFO cinder.volume.manager [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 23 15:05:54 devstack cinder-volume[85245]: WARNING stevedore.named [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 15:05:54 devstack cinder-volume[85245]: WARNING castellan.key_manager [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 15:05:54 devstack cinder-volume[85245]: WARNING cinder.keymgr.conf_key_mgr [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 15:05:54 devstack cinder-volume[85245]: INFO cinder.volume.manager [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_db.sqlalchemy.engines [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85245) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 15:05:54 devstack cinder-volume[85245]: INFO oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Starting 1 workers Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Started child 85459 {{(pid=85245) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Full set of CONF: {{(pid=85245) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] ******************************************************************************** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Configuration options gathered from: {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] ================================================================================ {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] allow_availability_zone_fallback = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] allow_compression_on_image_upload = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] allowed_direct_url_schemes = [] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] api_rate_limit = True {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] auth_strategy = keystone {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_availability_zone = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_host = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_name = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85459]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_stats_polling_interval = 60 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backup_api_class = cinder.backup.api.API {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backup_name_template = backup-%s {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backup_use_same_host = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backup_use_temp_snapshot = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] chap_password = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] chap_username = {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cinder_internal_tenant_project_id = 2a925ece0aa049e383abee97a788155c {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cinder_internal_tenant_user_id = 04623572b416473cb9138f9fb1e9430f {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cluster = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] compression_format = gzip {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] compute_api_class = cinder.compute.nova.API {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] config_dir = [] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] config_source = [] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] control_exchange = openstack {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] debug = True {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] default_availability_zone = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] default_group_type = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] default_volume_type = QuobyteHD {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] disk_geometry = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] driver_client_cert = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] driver_client_cert_key = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] driver_data_namespace = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] driver_ssl_cert_path = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] driver_ssl_cert_verify = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] driver_use_ssl = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] enable_new_services = True {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] enable_unsupported_driver = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] enabled_backends = ['QuobyteHD'] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] enforce_multipath_for_image_xfer = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] filter_function = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] glance_api_insecure = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] glance_api_servers = ['http://192.168.122.224/image'] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] glance_api_ssl_compression = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] glance_ca_certificates_file = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] glance_catalog_info = image:glance:publicURL {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] glance_certfile = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] glance_keyfile = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] glance_num_retries = 3 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] glance_request_timeout = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] goodness_function = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] graceful_shutdown_timeout = 5 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] group_api_class = cinder.group.api.API {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] host = devstack {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] image_compress_on_upload = True {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] image_conversion_address_space_limit = 1 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] image_conversion_cpu_limit = 60 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] image_conversion_disable = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] image_introspection_address_space_limit = 1 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] image_introspection_cpu_limit = 60 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] image_upload_use_cinder_backend = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] image_upload_use_internal_tenant = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] image_volume_cache_enabled = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] image_volume_cache_max_count = 0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] image_volume_cache_max_size_gb = 0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] init_host_max_objects_retrieval = 0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] instance_format = [instance: %(uuid)s] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] iscsi_target_flags = {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] iscsi_write_cache = on {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] iser_helper = tgtadm {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] iser_ip_address = 192.168.122.224 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] iser_port = 3260 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] log_color = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] log_config_append = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] log_dir = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] log_file = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] log_options = True {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] log_rotate_interval = 1 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] log_rotate_interval_type = days {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] log_rotation_type = none {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] max_age = 0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85459]: INFO cinder.volume.manager [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] max_logfile_count = 30 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85459]: DEBUG cinder.volume.drivers.remotefs [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85459) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] max_logfile_size_mb = 200 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] max_over_subscription_ratio = 20.0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] message_reap_interval = 86400 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] message_ttl = 2592000 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] migration_create_volume_timeout_secs = 300 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] monkey_patch = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] monkey_patch_modules = [] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] my_ip = 192.168.122.224 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] no_snapshot_gb_quota = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] num_iser_scan_tries = 3 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] num_shell_tries = 3 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] num_volume_device_scan_tries = 3 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] nvmeof_conn_info_version = 1 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] nvmet_ns_id = 10 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] nvmet_port_id = 1 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] osapi_max_limit = 1000 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] osapi_volume_ext_list = [] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] osapi_volume_listen_port = 8776 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] osapi_volume_use_ssl = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] osapi_volume_workers = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] per_volume_size_limit = -1 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] periodic_fuzzy_delay = 60 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] periodic_interval = 60 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] public_endpoint = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] publish_errors = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] quota_backup_gigabytes = 1000 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] quota_backups = 10 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] quota_gigabytes = 1000 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] quota_groups = 10 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] quota_snapshots = 10 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] quota_volumes = 10 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] rate_limit_burst = 0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] rate_limit_except_level = CRITICAL {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] rate_limit_interval = 0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] reinit_driver_count = 3 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] replication_device = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] report_discard_supported = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] report_interval = 120 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] reservation_clean_interval = 86400 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] reservation_expire = 86400 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] reserved_image_namespaces = [] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] reserved_percentage = 0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] rpc_response_timeout = 120 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] run_external_periodic_tasks = True {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] scst_target_driver = iscsi {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] scst_target_iqn_name = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] service_down_time = 720 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] shell_completion = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] snapshot_name_template = snapshot-%s {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] split_loggers = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] state_path = /opt/stack/data/cinder {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] storage_availability_zone = nova {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] storage_protocol = iSCSI {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] syslog_log_facility = LOG_USER {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] target_helper = lioadm {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] target_ip_address = 192.168.122.224 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] target_port = 3260 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] target_protocol = iscsi {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] target_secondary_ip_addresses = [] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] trace_flags = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] transport_url = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] until_refresh = 0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] use_chap_auth = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] use_default_quota_class = True {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] use_journal = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] use_json = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] use_multipath_for_image_xfer = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] use_stderr = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] use_syslog = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] verify_glance_signatures = enabled {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] volume_api_class = cinder.volume.api.API {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] volume_backend_name = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] volume_clear = zero {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] volume_clear_ionice = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] volume_clear_size = 0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] volume_copy_bps_limit = 0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] volume_dd_blocksize = 1M {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] volume_name_template = volume-%s {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] volume_service_inithost_offload = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] volume_usage_audit_period = month {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] zoning_mode = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_concurrency.disable_process_locking = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.auth_section = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.auth_type = password {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.auth_version = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.cache = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.certfile = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.include_service_catalog = True {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.insecure = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.interface = public {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.keyfile = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.memcache_password = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.memcache_username = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.region_name = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.service_type = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.224/identity {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.backend = dogpile.cache.null {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.backend_argument = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.backend_expiration_time = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.config_prefix = cache.oslo {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.debug_cache_backend = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.enable_retry_client = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.enable_socket_keepalive = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.enabled = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.expiration_time = 600 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.hashclient_retry_attempts = 2 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.memcache_dead_retry = 300 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.memcache_pool_maxsize = 10 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.memcache_sasl_enabled = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:54 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.password = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.proxies = [] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.redis_db = 0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.redis_server = localhost:6379 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.retry_attempts = 2 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.retry_delay = 0.0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.socket_keepalive_count = 1 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.socket_keepalive_idle = 1 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.socket_keepalive_interval = 1 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.socket_timeout = 1.0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.tls_allowed_ciphers = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.tls_cafile = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.tls_certfile = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.tls_enabled = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.tls_keyfile = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cache.username = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] coordination.backend_url = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.asyncio_connection = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.asyncio_slave_connection = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.backend = sqlalchemy {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.connection = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.connection_debug = 0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.connection_parameters = {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.connection_recycle_time = 3600 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.connection_trace = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.db_inc_retry_interval = True {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.db_max_retries = 20 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.db_max_retry_interval = 10 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.db_retry_interval = 1 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.max_overflow = 50 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.max_pool_size = 5 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.max_retries = 10 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.mysql_wsrep_sync_wait = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.pool_timeout = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.retry_interval = 10 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.slave_connection = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.sqlite_synchronous = True {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.synchronous_reader = True {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] database.use_db_reconnect = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_tracing.insecure = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG cinder.volume.drivers.quobyte [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85459) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] profiler.connection_string = messaging:// {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] profiler.enabled = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] profiler.es_doc_type = notification {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] profiler.es_scroll_size = 10000 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] profiler.es_scroll_time = 2m {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] profiler.filter_error_trace = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] profiler.hmac_keys = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] profiler.sentinel_service_name = mymaster {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] profiler.socket_timeout = 0.1 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] profiler.trace_requests = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] profiler.trace_sqlalchemy = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] profiler_jaeger.process_tags = {} {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] profiler_jaeger.service_name_prefix = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] profiler_otlp.service_name_prefix = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85459]: WARNING cinder.volume.drivers.quobyte [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 23 15:05:55 devstack cinder-volume[85459]: WARNING cinder.volume.drivers.quobyte [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_policy.enforce_new_defaults = True {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_policy.policy_default_rule = default {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_policy.policy_file = policy.yaml {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG oslo_concurrency.processutils [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Running cmd (subprocess): mount.quobyte {{(pid=85459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] privsep_osbrick.group = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] privsep_osbrick.helper_command = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] privsep_osbrick.user = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cinder_sys_admin.group = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cinder_sys_admin.helper_command = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] cinder_sys_admin.user = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] service_user.auth_section = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] service_user.auth_type = password {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] service_user.cafile = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] service_user.certfile = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] service_user.collect_timing = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] service_user.insecure = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] service_user.keyfile = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] service_user.send_service_user_token = True {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] service_user.split_loggers = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] service_user.timeout = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] service_user.tls_ciphers = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] service_user.tls_min_version = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] glance.auth_section = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] glance.auth_type = password {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] glance.certfile = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] glance.collect_timing = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] glance.insecure = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] glance.keyfile = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] glance.region_name = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] glance.split_loggers = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] glance.timeout = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] glance.tls_ciphers = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] glance.tls_min_version = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.backend_availability_zone = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.chap_password = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.chap_username = {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.disk_geometry = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.driver_client_cert = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.driver_client_cert_key = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.driver_data_namespace = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.driver_use_ssl = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.extra_capabilities = {} {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.filter_function = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.goodness_function = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.iscsi_target_flags = {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.iscsi_write_cache = on {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.iser_helper = tgtadm {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.iser_ip_address = 192.168.122.224 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.iser_port = 3260 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.nas_host = {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.nas_login = admin {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.nas_mount_options = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.nas_password = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.nas_private_key = {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.nas_share_path = {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.num_shell_tries = 3 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.quobyte_volume_url = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.replication_device = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.report_discard_supported = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.reserved_percentage = 0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.target_helper = tgtadm {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.target_ip_address = 192.168.122.224 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.target_port = 3260 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.target_protocol = iscsi {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.trace_flags = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.unique_fqdn_network = True {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.use_chap_auth = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.volume_backend_name = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.volume_clear = zero {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.volume_clear_ionice = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.volume_clear_size = 0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_reports.file_event_handler = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_reports.log_dir = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.backend_availability_zone = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.backend_host = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.chap_password = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.chap_username = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.chiscsi_conf = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.disk_geometry = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.driver_client_cert = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.driver_data_namespace = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.driver_use_ssl = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.extra_capabilities = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.filter_function = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.goodness_function = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.iser_helper = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.iser_ip_address = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.iser_port = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.iser_target_prefix = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.nas_host = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.nas_login = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.nas_mount_options = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.nas_password = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.nas_private_key = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.nas_share_path = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.nas_ssh_port = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.num_shell_tries = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.nvmet_port_id = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.replication_device = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.report_discard_supported = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.reserved_percentage = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.scst_target_driver = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.storage_protocol = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.target_helper = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.target_ip_address = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.target_port = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.target_prefix = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.target_protocol = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.trace_flags = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.use_chap_auth = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.volume_clear = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.volume_clear_size = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] QuobyteHD.volumes_dir = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.ssl = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_notifications.driver = [] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_notifications.retry = -1 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] key_manager.fixed_key = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican.barbican_api_version = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican.barbican_endpoint = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican.barbican_endpoint_type = public {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican.barbican_region_name = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican.cafile = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican.certfile = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican.collect_timing = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican.insecure = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican.keyfile = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican.number_of_retries = 60 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican.retry_delay = 1 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican.send_service_user_token = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican.split_loggers = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican.timeout = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican.tls_ciphers = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican.tls_min_version = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican.verify_ssl = True {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican.verify_ssl_path = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican_service_user.auth_section = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican_service_user.auth_type = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican_service_user.cafile = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican_service_user.certfile = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican_service_user.collect_timing = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican_service_user.insecure = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican_service_user.keyfile = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican_service_user.split_loggers = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican_service_user.timeout = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican_service_user.tls_ciphers = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] barbican_service_user.tls_min_version = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] vault.approle_role_id = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] vault.approle_secret_id = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] vault.auth_method = approle {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] vault.auth_path = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] vault.kv_mountpoint = secret {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] vault.kv_path = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] vault.kv_version = 2 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] vault.namespace = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] vault.root_token_id = **** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] vault.ssl_ca_crt_file = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] vault.timeout = 60.0 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] vault.token_file = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] vault.token_role = None {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] vault.use_ssl = False {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG oslo_concurrency.processutils [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] CMD "mount.quobyte" returned: 1 in 0.142s {{(pid=85459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG oslo_concurrency.lockutils [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG oslo_concurrency.lockutils [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG cinder.volume.drivers.quobyte [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=85459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:05:55 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] ******************************************************************************** {{(pid=85245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 15:05:55 devstack cinder-volume[85459]: INFO cinder.volume.drivers.quobyte [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 ... Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG oslo_concurrency.processutils [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df -c /etc/quobyte/client-cinder.cfg {{(pid=85459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:05:55 devstack sudo[85465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df -c /etc/quobyte/client-cinder.cfg Sep 23 15:05:55 devstack sudo[85465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:05:55 devstack sudo[85465]: pam_unix(sudo:session): session closed for user root Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG oslo_concurrency.processutils [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.388s {{(pid=85459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:05:55 devstack cinder-volume[85459]: INFO cinder.volume.drivers.quobyte [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 succeeded Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG cinder.volume.drivers.quobyte [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=85459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG oslo_concurrency.lockutils [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.399s {{(pid=85459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG oslo_concurrency.processutils [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=85459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:05:55 devstack sudo[85565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:05:55 devstack sudo[85565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:05:55 devstack sudo[85565]: pam_unix(sudo:session): session closed for user root Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG oslo_concurrency.processutils [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.250s {{(pid=85459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:05:55 devstack cinder-volume[85459]: INFO cinder.volume.driver [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Driver hasn't implemented _init_vendor_properties() Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG cinder.volume.driver [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4478797912598, 'free_capacity_gb': 1775.4478797912598, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85459) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG oslo_db.sqlalchemy.engines [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85459) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG dbcounter [-] [85459] Writer thread running {{(pid=85459) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG cinder.db.api [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Building query based on filter {{(pid=85459) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG cinder.image.image_utils [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85459) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 15:05:55 devstack cinder-volume[85459]: INFO cinder.keymgr.migration [None req-dffe8bb4-1fa6-403e-a628-eb1ddbf43107 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG oslo_concurrency.lockutils [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG oslo_concurrency.lockutils [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG cinder.volume.drivers.quobyte [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=85459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG cinder.volume.drivers.quobyte [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=85459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG oslo_concurrency.lockutils [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:05:55 devstack cinder-volume[85459]: DEBUG oslo_concurrency.processutils [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=85459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:05:56 devstack sudo[85568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:05:56 devstack sudo[85568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:05:56 devstack sudo[85568]: pam_unix(sudo:session): session closed for user root Sep 23 15:05:56 devstack cinder-volume[85459]: DEBUG oslo_concurrency.processutils [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.231s {{(pid=85459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:05:56 devstack cinder-volume[85459]: DEBUG cinder.manager [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Notifying Schedulers of capabilities ... {{(pid=85459) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:05:56 devstack cinder-volume[85459]: INFO cinder.volume.manager [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Driver initialization completed successfully. Sep 23 15:05:56 devstack cinder-volume[85459]: INFO cinder.manager [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Initiating service 3 cleanup Sep 23 15:05:56 devstack cinder-volume[85459]: INFO cinder.manager [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Service 3 cleanup completed. Sep 23 15:05:56 devstack cinder-volume[85459]: DEBUG cinder.service [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Creating RPC server for service cinder-volume {{(pid=85459) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 15:05:56 devstack cinder-volume[85459]: DEBUG cinder.service [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85459) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 15:05:56 devstack cinder-volume[85459]: INFO cinder.volume.manager [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 23 15:05:56 devstack cinder-volume[85459]: DEBUG oslo_concurrency.lockutils [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:05:56 devstack cinder-volume[85459]: DEBUG oslo_concurrency.lockutils [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:05:56 devstack cinder-volume[85459]: DEBUG cinder.volume.drivers.quobyte [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=85459) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:05:56 devstack cinder-volume[85459]: DEBUG cinder.volume.drivers.quobyte [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=85459) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:05:56 devstack cinder-volume[85459]: DEBUG oslo_concurrency.lockutils [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85459) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:05:56 devstack cinder-volume[85459]: DEBUG oslo_concurrency.processutils [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=85459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:05:56 devstack sudo[85572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:05:56 devstack sudo[85572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:05:56 devstack sudo[85572]: pam_unix(sudo:session): session closed for user root Sep 23 15:05:56 devstack cinder-volume[85459]: DEBUG oslo_concurrency.processutils [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.272s {{(pid=85459) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:05:56 devstack cinder-volume[85459]: INFO cinder.volume.manager [None req-346226d6-81f6-47e6-9eee-8c22d829ceb2 None None] Driver post RPC initialization completed successfully. Sep 23 15:06:00 devstack cinder-volume[85245]: INFO oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Caught SIGTERM, stopping children Sep 23 15:06:00 devstack cinder-volume[85245]: DEBUG oslo_concurrency.lockutils [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Acquiring lock "singleton_lock" {{(pid=85245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 15:06:00 devstack cinder-volume[85245]: DEBUG oslo_concurrency.lockutils [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Acquired lock "singleton_lock" {{(pid=85245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 15:06:00 devstack cinder-volume[85245]: DEBUG oslo_concurrency.lockutils [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Releasing lock "singleton_lock" {{(pid=85245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 15:06:00 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Stop services. {{(pid=85245) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 23 15:06:00 devstack cinder-volume[85245]: DEBUG oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Killing children. {{(pid=85245) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 23 15:06:00 devstack cinder-volume[85245]: INFO oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Waiting on 1 children to exit Sep 23 15:06:00 devstack cinder-volume[85459]: DEBUG oslo_concurrency.lockutils [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Acquiring lock "singleton_lock" {{(pid=85459) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 15:06:00 devstack cinder-volume[85459]: DEBUG oslo_concurrency.lockutils [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Acquired lock "singleton_lock" {{(pid=85459) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 15:06:00 devstack cinder-volume[85459]: DEBUG oslo_concurrency.lockutils [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Releasing lock "singleton_lock" {{(pid=85459) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 15:06:00 devstack cinder-volume[85459]: WARNING amqp [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 15:06:00 devstack cinder-volume[85459]: WARNING amqp [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 15:06:00 devstack cinder-volume[85245]: INFO oslo_service.backend._eventlet.service [None req-4a8e10cd-73bb-4fca-991d-dfeb332a3024 None None] Child 85459 exited with status 0 Sep 23 15:06:01 devstack cinder-volume[85761]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 15:06:01 devstack cinder-volume[85761]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 15:06:01 devstack cinder-volume[85761]: we strongly recommend against using it for new projects. Sep 23 15:06:01 devstack cinder-volume[85761]: If you are already using Eventlet, we recommend migrating to a different Sep 23 15:06:01 devstack cinder-volume[85761]: framework. For more detail see Sep 23 15:06:01 devstack cinder-volume[85761]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 15:06:01 devstack cinder-volume[85761]: import eventlet # noqa Sep 23 15:06:03 devstack cinder-volume[85761]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85761) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 15:06:03 devstack cinder-volume[85761]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85761) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 15:06:03 devstack cinder-volume[85761]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85761) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 15:06:05 devstack cinder-volume[85761]: INFO dbcounter [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] Registered counter for database cinder Sep 23 15:06:05 devstack cinder-volume[85761]: DEBUG oslo_db.sqlalchemy.engines [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85761) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 15:06:05 devstack cinder-volume[85761]: DEBUG dbcounter [-] [85761] Writer thread running {{(pid=85761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 15:06:05 devstack cinder-volume[85761]: INFO cinder.rpc [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 15:06:05 devstack cinder-volume[85761]: INFO cinder.rpc [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_db.sqlalchemy.engines [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85761) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 15:06:06 devstack cinder-volume[85761]: INFO cinder.volume.manager [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] Determined volume DB was empty at startup. Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG cinder.volume.manager [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85761) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 15:06:06 devstack cinder-volume[85761]: WARNING stevedore.named [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 15:06:06 devstack cinder-volume[85761]: WARNING castellan.key_manager [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 15:06:06 devstack cinder-volume[85761]: WARNING cinder.keymgr.conf_key_mgr [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 15:06:06 devstack cinder-volume[85761]: INFO cinder.volume.manager [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_db.sqlalchemy.engines [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85761) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 15:06:06 devstack cinder-volume[85761]: INFO oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] Starting 1 workers Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] Started child 86064 {{(pid=85761) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] Full set of CONF: {{(pid=85761) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] ******************************************************************************** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] Configuration options gathered from: {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] ================================================================================ {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] allow_availability_zone_fallback = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] allow_compression_on_image_upload = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] allowed_direct_url_schemes = [] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] api_rate_limit = True {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] auth_strategy = keystone {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_availability_zone = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_host = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_name = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_stats_polling_interval = 60 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backup_api_class = cinder.backup.api.API {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backup_name_template = backup-%s {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backup_use_same_host = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backup_use_temp_snapshot = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] chap_password = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] chap_username = {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cinder_internal_tenant_project_id = 2a925ece0aa049e383abee97a788155c {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cinder_internal_tenant_user_id = 04623572b416473cb9138f9fb1e9430f {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cluster = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] compression_format = gzip {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] compute_api_class = cinder.compute.nova.API {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] config_dir = [] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] config_source = [] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] control_exchange = openstack {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] debug = True {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] default_availability_zone = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] default_group_type = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] default_volume_type = QuobyteHD {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] disk_geometry = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] driver_client_cert = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] driver_client_cert_key = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] driver_data_namespace = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] driver_ssl_cert_path = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] driver_ssl_cert_verify = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] driver_use_ssl = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[86064]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] enable_new_services = True {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] enable_unsupported_driver = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] enabled_backends = ['QuobyteHD'] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] enforce_multipath_for_image_xfer = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] filter_function = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] glance_api_insecure = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] glance_api_servers = ['http://192.168.122.224/image'] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] glance_api_ssl_compression = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] glance_ca_certificates_file = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] glance_catalog_info = image:glance:publicURL {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] glance_certfile = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] glance_keyfile = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] glance_num_retries = 3 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] glance_request_timeout = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] goodness_function = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] graceful_shutdown_timeout = 5 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] group_api_class = cinder.group.api.API {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] host = devstack {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] image_compress_on_upload = True {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] image_conversion_address_space_limit = 1 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] image_conversion_cpu_limit = 60 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] image_conversion_disable = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] image_introspection_address_space_limit = 1 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] image_introspection_cpu_limit = 60 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] image_upload_use_cinder_backend = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] image_upload_use_internal_tenant = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] image_volume_cache_enabled = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] image_volume_cache_max_count = 0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] image_volume_cache_max_size_gb = 0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] init_host_max_objects_retrieval = 0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] instance_format = [instance: %(uuid)s] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] iscsi_target_flags = {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] iscsi_write_cache = on {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] iser_helper = tgtadm {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] iser_ip_address = 192.168.122.224 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] iser_port = 3260 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] log_color = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] log_config_append = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] log_dir = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] log_file = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] log_options = True {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] log_rotate_interval = 1 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] log_rotate_interval_type = days {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] log_rotation_type = none {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] max_age = 0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] max_logfile_count = 30 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] max_logfile_size_mb = 200 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] max_over_subscription_ratio = 20.0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] message_reap_interval = 86400 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] message_ttl = 2592000 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] migration_create_volume_timeout_secs = 300 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] monkey_patch = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] monkey_patch_modules = [] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] my_ip = 192.168.122.224 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] no_snapshot_gb_quota = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] num_iser_scan_tries = 3 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] num_shell_tries = 3 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] num_volume_device_scan_tries = 3 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] nvmeof_conn_info_version = 1 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] nvmet_ns_id = 10 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] nvmet_port_id = 1 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] osapi_max_limit = 1000 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] osapi_volume_ext_list = [] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] osapi_volume_listen = 0.0.0.0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] osapi_volume_listen_port = 8776 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] osapi_volume_use_ssl = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] osapi_volume_workers = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] per_volume_size_limit = -1 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] periodic_fuzzy_delay = 60 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] periodic_interval = 60 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] project_id_regex = [0-9a-f\-]+ {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] public_endpoint = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] publish_errors = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] quota_backup_gigabytes = 1000 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] quota_backups = 10 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] quota_gigabytes = 1000 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] quota_groups = 10 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] quota_snapshots = 10 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] quota_volumes = 10 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] rate_limit_burst = 0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] rate_limit_except_level = CRITICAL {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] rate_limit_interval = 0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] reinit_driver_count = 3 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] replication_device = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] report_discard_supported = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] report_interval = 120 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] reservation_clean_interval = 86400 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] reservation_expire = 86400 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] reserved_image_namespaces = [] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] reserved_percentage = 0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] rpc_response_timeout = 120 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] run_external_periodic_tasks = True {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] scst_target_driver = iscsi {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] scst_target_iqn_name = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] service_down_time = 720 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] shell_completion = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] snapshot_name_template = snapshot-%s {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] split_loggers = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] state_path = /opt/stack/data/cinder {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] storage_availability_zone = nova {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] storage_protocol = iSCSI {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] syslog_log_facility = LOG_USER {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] target_helper = lioadm {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] target_ip_address = 192.168.122.224 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] target_port = 3260 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] target_protocol = iscsi {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] target_secondary_ip_addresses = [] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] trace_flags = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] transfer_api_class = cinder.transfer.api.API {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] transport_url = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] until_refresh = 0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] use_chap_auth = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] use_default_quota_class = True {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] use_journal = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] use_json = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] use_multipath_for_image_xfer = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] use_stderr = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] use_syslog = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] verify_glance_signatures = enabled {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] volume_api_class = cinder.volume.api.API {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] volume_backend_name = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] volume_clear = zero {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] volume_clear_ionice = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] volume_clear_size = 0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] volume_copy_bps_limit = 0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] volume_dd_blocksize = 1M {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] volume_name_template = volume-%s {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] volume_service_inithost_offload = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] volume_usage_audit_period = month {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] zoning_mode = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_concurrency.disable_process_locking = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.auth_section = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.auth_type = password {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.auth_version = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.cache = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.certfile = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.delay_auth_decision = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.http_connect_timeout = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.include_service_catalog = True {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.insecure = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.interface = public {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.keyfile = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.memcache_password = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.memcache_username = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.region_name = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.service_token_roles_required = True {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.service_type = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.token_cache_time = 300 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.224/identity {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.backend = dogpile.cache.null {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.backend_argument = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.backend_expiration_time = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.config_prefix = cache.oslo {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.debug_cache_backend = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.enable_retry_client = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.enable_socket_keepalive = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.enabled = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.expiration_time = 600 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.hashclient_retry_attempts = 2 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.memcache_dead_retry = 300 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.memcache_pool_maxsize = 10 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.memcache_sasl_enabled = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.password = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.proxies = [] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.redis_db = 0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.redis_sentinel_service_name = mymaster {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.redis_server = localhost:6379 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.retry_attempts = 2 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.retry_delay = 0.0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 23 15:06:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86064) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.socket_keepalive_count = 1 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.socket_keepalive_idle = 1 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.socket_keepalive_interval = 1 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.socket_timeout = 1.0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.tls_allowed_ciphers = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.tls_cafile = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.tls_certfile = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.tls_enabled = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.tls_keyfile = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cache.username = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] coordination.backend_url = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.asyncio_connection = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.asyncio_slave_connection = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.backend = sqlalchemy {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.connection = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.connection_debug = 0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.connection_parameters = {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.connection_recycle_time = 3600 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.connection_trace = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.db_inc_retry_interval = True {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.db_max_retries = 20 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.db_max_retry_interval = 10 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.db_retry_interval = 1 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.max_overflow = 50 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.max_pool_size = 5 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.max_retries = 10 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.mysql_wsrep_sync_wait = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.pool_timeout = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.retry_interval = 10 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.slave_connection = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.sqlite_synchronous = True {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.synchronous_reader = True {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] database.use_db_reconnect = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_tracing.insecure = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] profiler.connection_string = messaging:// {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] profiler.enabled = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] profiler.es_doc_type = notification {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] profiler.es_scroll_size = 10000 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] profiler.es_scroll_time = 2m {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] profiler.filter_error_trace = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] profiler.hmac_keys = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] profiler.sentinel_service_name = mymaster {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] profiler.socket_timeout = 0.1 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] profiler.trace_requests = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] profiler.trace_sqlalchemy = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] profiler_jaeger.process_tags = {} {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] profiler_jaeger.service_name_prefix = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] profiler_otlp.service_name_prefix = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_policy.enforce_new_defaults = True {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_policy.policy_default_rule = default {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_policy.policy_file = policy.yaml {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_policy.remote_timeout = 60.0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] privsep_osbrick.group = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] privsep_osbrick.helper_command = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] privsep_osbrick.user = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cinder_sys_admin.group = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cinder_sys_admin.helper_command = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] cinder_sys_admin.user = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] service_user.auth_section = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] service_user.auth_type = password {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] service_user.cafile = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] service_user.certfile = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] service_user.collect_timing = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] service_user.insecure = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] service_user.keyfile = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] service_user.send_service_user_token = True {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] service_user.split_loggers = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] service_user.timeout = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] service_user.tls_ciphers = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] service_user.tls_min_version = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] glance.auth_section = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] glance.auth_type = password {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] glance.certfile = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] glance.collect_timing = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] glance.insecure = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] glance.keyfile = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] glance.region_name = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] glance.split_loggers = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] glance.timeout = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] glance.tls_ciphers = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] glance.tls_min_version = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.backend_availability_zone = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.chap_password = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.chap_username = {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.disk_geometry = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.driver_client_cert = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.driver_client_cert_key = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.driver_data_namespace = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.driver_use_ssl = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.enable_unsupported_driver = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.extra_capabilities = {} {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.filter_function = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.goodness_function = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.iscsi_target_flags = {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.iscsi_write_cache = on {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.iser_helper = tgtadm {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.iser_ip_address = 192.168.122.224 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.iser_port = 3260 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.nas_host = {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.nas_login = admin {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86064) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 23 15:06:06 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.quobyte [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 23 15:06:06 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.quobyte [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 23 15:06:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Running cmd (subprocess): mount.quobyte {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.nas_mount_options = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.nas_password = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.nas_private_key = {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.nas_share_path = {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.nas_ssh_port = 22 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.num_shell_tries = 3 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.nvmet_port_id = 1 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.quobyte_client_cfg = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.quobyte_volume_url = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.replication_device = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.report_discard_supported = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.reserved_percentage = 0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.scst_target_driver = iscsi {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.scst_target_iqn_name = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.storage_protocol = iSCSI {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.target_helper = tgtadm {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.target_ip_address = 192.168.122.224 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.target_port = 3260 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.target_protocol = iscsi {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.trace_flags = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.unique_fqdn_network = True {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.use_chap_auth = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.volume_backend_name = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.volume_clear = zero {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.volume_clear_ionice = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.volume_clear_size = 0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_reports.file_event_handler = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_reports.log_dir = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.backend_availability_zone = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.backend_host = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack quobyte-client[86071]: Reading configuration file: /etc/quobyte/client.cfg Sep 23 15:06:06 devstack quobyte-client[86071]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.chap_password = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.chap_username = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.chiscsi_conf = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.disk_geometry = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.driver_client_cert = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.driver_client_cert_key = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.driver_data_namespace = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.driver_use_ssl = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.extra_capabilities = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.filter_function = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] CMD "mount.quobyte" returned: 1 in 0.086s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:06:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:06:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:06:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.goodness_function = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.iscsi_target_flags = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.iscsi_write_cache = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.iser_helper = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.iser_ip_address = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.iser_port = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.iser_target_prefix = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.nas_host = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.nas_login = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.nas_mount_options = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.nas_password = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.nas_private_key = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.nas_share_path = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.nas_ssh_port = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.num_shell_tries = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.nvmet_ns_id = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.nvmet_port_id = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.replication_device = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.report_discard_supported = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.reserved_percentage = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.scst_target_driver = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.storage_protocol = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.target_helper = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.target_ip_address = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.target_port = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.target_prefix = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.target_protocol = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.trace_flags = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.unique_fqdn_network = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.use_chap_auth = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.volume_clear = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:06:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:06:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.volume_clear_ionice = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.volume_clear_size = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] QuobyteHD.volumes_dir = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.ssl = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.ssl_version = {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_notifications.driver = [] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_notifications.retry = -1 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] oslo_messaging_notifications.transport_url = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] key_manager.fixed_key = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican.barbican_api_version = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican.barbican_endpoint = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican.barbican_endpoint_type = public {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican.barbican_region_name = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican.cafile = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican.certfile = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican.collect_timing = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack sudo[86073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:06:06 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican.insecure = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican.keyfile = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican.number_of_retries = 60 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican.retry_delay = 1 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican.send_service_user_token = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican.split_loggers = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican.timeout = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican.tls_ciphers = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican.tls_min_version = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican.verify_ssl = True {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican.verify_ssl_path = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican_service_user.auth_section = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican_service_user.auth_type = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican_service_user.cafile = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican_service_user.certfile = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican_service_user.collect_timing = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican_service_user.insecure = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican_service_user.keyfile = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican_service_user.split_loggers = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican_service_user.timeout = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican_service_user.tls_ciphers = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] barbican_service_user.tls_min_version = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] vault.approle_role_id = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] vault.approle_secret_id = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] vault.auth_method = approle {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] vault.auth_path = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] vault.kv_mountpoint = secret {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] vault.kv_path = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] vault.kv_version = 2 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] vault.namespace = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] vault.root_token_id = **** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] vault.ssl_ca_crt_file = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] vault.timeout = 60.0 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] vault.token_file = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] vault.token_role = None {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] vault.use_ssl = False {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 15:06:06 devstack cinder-volume[85761]: DEBUG oslo_service.backend._eventlet.service [None req-bed1a115-5552-49e4-90de-1bfb6c07bd7e None None] ******************************************************************************** {{(pid=85761) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 15:06:06 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root Sep 23 15:06:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.396s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:06:06 devstack cinder-volume[86064]: INFO cinder.volume.driver [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Driver hasn't implemented _init_vendor_properties() Sep 23 15:06:06 devstack cinder-volume[86064]: DEBUG cinder.volume.driver [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4478797912598, 'free_capacity_gb': 1775.4478797912598, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86064) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 15:06:07 devstack cinder-volume[86064]: DEBUG oslo_db.sqlalchemy.engines [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86064) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 15:06:07 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writer thread running {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 15:06:07 devstack cinder-volume[86064]: DEBUG cinder.db.api [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Building query based on filter {{(pid=86064) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 23 15:06:07 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86064) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 15:06:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:06:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:06:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:06:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:06:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:06:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:06:07 devstack cinder-volume[86064]: INFO cinder.keymgr.migration [None req-b2d9beb1-9c77-4436-a41b-57d9ea7631fb None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 15:06:07 devstack sudo[86087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:06:07 devstack sudo[86087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:06:07 devstack sudo[86087]: pam_unix(sudo:session): session closed for user root Sep 23 15:06:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.355s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:06:07 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:06:07 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Driver initialization completed successfully. Sep 23 15:06:07 devstack cinder-volume[86064]: INFO cinder.manager [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Initiating service 3 cleanup Sep 23 15:06:07 devstack cinder-volume[86064]: INFO cinder.manager [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Service 3 cleanup completed. Sep 23 15:06:07 devstack cinder-volume[86064]: DEBUG cinder.service [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Creating RPC server for service cinder-volume {{(pid=86064) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 15:06:07 devstack cinder-volume[86064]: DEBUG cinder.service [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86064) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 15:06:07 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 23 15:06:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:06:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:06:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:06:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:06:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:06:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:06:07 devstack sudo[86099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:06:07 devstack sudo[86099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:06:08 devstack sudo[86099]: pam_unix(sudo:session): session closed for user root Sep 23 15:06:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.249s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:06:08 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-4d49d947-5034-4f9e-a4f3-34962f9f5ad6 None None] Driver post RPC initialization completed successfully. Sep 23 15:06:16 devstack cinder-volume[85761]: DEBUG dbcounter [-] [85761] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85761) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:06:17 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=3 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:06:18 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:06:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:06:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 6 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:06:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:07:06 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-b0cb5c99-dc19-4b4e-8153-4c57c3a615f7 tempest-GroupSnapshotsV319Test-1869548855 None] Group tempest-GroupSnapshotsV319Test-Group-1920311851: creating Sep 23 15:07:06 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-b0cb5c99-dc19-4b4e-8153-4c57c3a615f7 tempest-GroupSnapshotsV319Test-1869548855 None] Group tempest-GroupSnapshotsV319Test-Group-1920311851: created successfully Sep 23 15:07:06 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-b0cb5c99-dc19-4b4e-8153-4c57c3a615f7 tempest-GroupSnapshotsV319Test-1869548855 None] Create group completed successfully. Sep 23 15:07:08 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:07:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Flow 'volume_create_manager' (69c030fc-9543-4487-b63d-35b519a7d86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:07:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bdb289-ce91-4b71-8f5e-442307b0831f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bdb289-ce91-4b71-8f5e-442307b0831f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-283510815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dedb5e44-5797-41cb-8066-da909e7f4268,host='devstack@QuobyteHD#QuobyteHD',id=fb5e129f-61ea-4510-934f-4a900049cc47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81c67cf9fbb4727a5d4340ba62a1fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:07:08Z,use_quota=True,user_id='0de7181f698c4494841ed7439d351460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c4f298d-5d42-4829-ac5d-f2cc96af0c10),volume_type_id=5c4f298d-5d42-4829-ac5d-f2cc96af0c10)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9674e048-c7f0-426f-907c-850bf27c9ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9674e048-c7f0-426f-907c-850bf27c9ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bff205e-d7e3-4cbf-ac08-e33039165829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bff205e-d7e3-4cbf-ac08-e33039165829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb5e129f-61ea-4510-934f-4a900049cc47', 'volume_name': 'volume-fb5e129f-61ea-4510-934f-4a900049cc47', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4450a632-b9d8-4e58-8d37-37701ce1af22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4450a632-b9d8-4e58-8d37-37701ce1af22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95be6a7f-b6ed-4d0d-9855-a495d8ce3035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:08 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Volume fb5e129f-61ea-4510-934f-4a900049cc47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb5e129f-61ea-4510-934f-4a900049cc47', 'volume_size': 1} Sep 23 15:07:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:07:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:07:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dedb5e44-5797-41cb-8066-da909e7f4268,created_at=2026-09-23T13:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-283510815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dedb5e44-5797-41cb-8066-da909e7f4268,host='devstack@QuobyteHD#QuobyteHD',id=fb5e129f-61ea-4510-934f-4a900049cc47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81c67cf9fbb4727a5d4340ba62a1fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:07:08Z,use_quota=True,user_id='0de7181f698c4494841ed7439d351460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c4f298d-5d42-4829-ac5d-f2cc96af0c10),volume_type_id=5c4f298d-5d42-4829-ac5d-f2cc96af0c10)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:07:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Creating volume fb5e129f-61ea-4510-934f-4a900049cc47 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:07:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:07:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:07:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:07:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:07:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:07:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:07:08 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:07:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:08 devstack sudo[86645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47 1073741824 Sep 23 15:07:08 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:09 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47 1073741824" returned: 0 in 1.004s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:09 devstack sudo[86963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47 Sep 23 15:07:09 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:10 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47" returned: 0 in 0.350s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:07:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:07:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95be6a7f-b6ed-4d0d-9855-a495d8ce3035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb5e129f-61ea-4510-934f-4a900049cc47', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265adc82-172b-4938-97ec-afd18e52f1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:10 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Volume volume-fb5e129f-61ea-4510-934f-4a900049cc47 (fb5e129f-61ea-4510-934f-4a900049cc47): created successfully Sep 23 15:07:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265adc82-172b-4938-97ec-afd18e52f1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Flow 'volume_create_manager' (69c030fc-9543-4487-b63d-35b519a7d86c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:07:10 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-b8c93c95-f8b5-4732-9749-e214e8770707 tempest-GroupSnapshotsV319Test-1869548855 None] Created volume successfully. Sep 23 15:07:11 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] GroupSnapshot d5ee8896-336c-4e85-b274-7be4b9c1a01c: creating. Sep 23 15:07:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] Group snapshot d5ee8896-336c-4e85-b274-7be4b9c1a01c: creating. {{(pid=86064) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 15:07:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:07:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:07:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] Creating offline snapshot 7603af5d-97ff-4d5d-b86b-8fa86af81939 of volume fb5e129f-61ea-4510-934f-4a900049cc47 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:07:11 devstack cinder-volume[86064]: INFO oslo.privsep.daemon [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmprtk298qu/privsep.sock'] Sep 23 15:07:11 devstack sudo[87025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmprtk298qu/privsep.sock Sep 23 15:07:11 devstack sudo[87025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:13 devstack cinder-volume[86064]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 23 15:07:13 devstack cinder-volume[86064]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 15:07:13 devstack cinder-volume[86064]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 23 15:07:13 devstack cinder-volume[86064]: WARNING oslo.privsep.daemon [-] privsep log: Sep 23 15:07:13 devstack cinder-volume[86064]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 23 15:07:13 devstack cinder-volume[86064]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 23 15:07:13 devstack cinder-volume[86064]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 15:07:13 devstack cinder-volume[86064]: WARNING oslo.privsep.daemon [-] privsep log: Sep 23 15:07:13 devstack cinder-volume[86064]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 23 15:07:13 devstack sudo[87025]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:13 devstack cinder-volume[86064]: INFO oslo.privsep.daemon [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] Spawned new privsep daemon via rootwrap Sep 23 15:07:13 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] Accepted privsep connection to /tmp/tmprtk298qu/privsep.sock {{(pid=86064) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 23 15:07:13 devstack cinder-volume[86064]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 23 15:07:13 devstack cinder-volume[86064]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 23 15:07:13 devstack cinder-volume[86064]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 23 15:07:13 devstack cinder-volume[86064]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87052 Sep 23 15:07:13 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d0a970-6401-4b4d-b9de-fa92d7515618]: (2,) {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:07:13 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f50a0b8-28e5-4262-bc10-bc9864ca6291]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:07:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:13 devstack sudo[87064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47 Sep 23 15:07:13 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:14 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47" returned: 0 in 0.545s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.7603af5d-97ff-4d5d-b86b-8fa86af81939 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:14 devstack sudo[87078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.7603af5d-97ff-4d5d-b86b-8fa86af81939 1G Sep 23 15:07:14 devstack sudo[87078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:14 devstack sudo[87078]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.7603af5d-97ff-4d5d-b86b-8fa86af81939 1G" returned: 0 in 0.704s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb5e129f-61ea-4510-934f-4a900049cc47 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.7603af5d-97ff-4d5d-b86b-8fa86af81939 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:14 devstack sudo[87104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb5e129f-61ea-4510-934f-4a900049cc47 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.7603af5d-97ff-4d5d-b86b-8fa86af81939 Sep 23 15:07:14 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:15 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb5e129f-61ea-4510-934f-4a900049cc47 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.7603af5d-97ff-4d5d-b86b-8fa86af81939" returned: 0 in 0.385s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:15 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.7603af5d-97ff-4d5d-b86b-8fa86af81939 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 15:07:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.7603af5d-97ff-4d5d-b86b-8fa86af81939 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:15 devstack sudo[87121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.7603af5d-97ff-4d5d-b86b-8fa86af81939 Sep 23 15:07:15 devstack sudo[87121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:15 devstack sudo[87121]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.7603af5d-97ff-4d5d-b86b-8fa86af81939" returned: 0 in 0.276s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:15 devstack sudo[87128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.info Sep 23 15:07:15 devstack sudo[87128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:16 devstack sudo[87128]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.info" returned: 0 in 0.432s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:16 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 15:07:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:16 devstack sudo[87133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.info Sep 23 15:07:16 devstack sudo[87133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:16 devstack sudo[87133]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.info" returned: 0 in 0.345s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.643s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:07:16 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-bb42b23c-817e-4249-b466-e2fdee013405 tempest-GroupSnapshotsV319Test-1869548855 None] group_snapshot d5ee8896-336c-4e85-b274-7be4b9c1a01c: created successfully Sep 23 15:07:17 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] group_snapshot d5ee8896-336c-4e85-b274-7be4b9c1a01c: deleting Sep 23 15:07:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] group_snapshot d5ee8896-336c-4e85-b274-7be4b9c1a01c: deleting {{(pid=86064) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 15:07:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] Acquiring lock "cinder-quobyte-fb5e129f-61ea-4510-934f-4a900049cc47" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:07:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] Lock "cinder-quobyte-fb5e129f-61ea-4510-934f-4a900049cc47" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:07:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] Acquiring lock "cinder-quobyte-7603af5d-97ff-4d5d-b86b-8fa86af81939" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:07:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] Lock "cinder-quobyte-7603af5d-97ff-4d5d-b86b-8fa86af81939" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:07:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] Deleting offline snapshot 7603af5d-97ff-4d5d-b86b-8fa86af81939 of volume fb5e129f-61ea-4510-934f-4a900049cc47 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:07:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] snapshot_file for this snap is: volume-fb5e129f-61ea-4510-934f-4a900049cc47.7603af5d-97ff-4d5d-b86b-8fa86af81939 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:07:17 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a256c2f4-fe16-4e99-8c0f-81b290b62f54]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:07:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.7603af5d-97ff-4d5d-b86b-8fa86af81939 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:18 devstack sudo[87141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.7603af5d-97ff-4d5d-b86b-8fa86af81939 Sep 23 15:07:18 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:18 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.7603af5d-97ff-4d5d-b86b-8fa86af81939" returned: 0 in 0.573s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb5e129f-61ea-4510-934f-4a900049cc47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:07:18 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[819e13bb-b138-42ab-8012-9b86febc482a]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:07:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:18 devstack sudo[87150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47 Sep 23 15:07:18 devstack sudo[87150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:18 devstack sudo[87150]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47" returned: 0 in 0.479s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.7603af5d-97ff-4d5d-b86b-8fa86af81939 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:19 devstack sudo[87155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.7603af5d-97ff-4d5d-b86b-8fa86af81939 Sep 23 15:07:19 devstack sudo[87155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:19 devstack sudo[87155]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.7603af5d-97ff-4d5d-b86b-8fa86af81939" returned: 0 in 0.798s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.7603af5d-97ff-4d5d-b86b-8fa86af81939 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:19 devstack sudo[87180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.7603af5d-97ff-4d5d-b86b-8fa86af81939 Sep 23 15:07:19 devstack sudo[87180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:20 devstack sudo[87180]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47.7603af5d-97ff-4d5d-b86b-8fa86af81939" returned: 0 in 0.709s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] Lock "cinder-quobyte-7603af5d-97ff-4d5d-b86b-8fa86af81939" released by "_delete_snapshot" :: held 2.772s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:07:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] Lock "cinder-quobyte-fb5e129f-61ea-4510-934f-4a900049cc47" released by "delete_snapshot" :: held 2.809s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:07:20 devstack cinder-volume[86064]: WARNING cinder.quota [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1346315690 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1346315690, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:07:20 devstack cinder-volume[86064]: WARNING cinder.quota [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1346315690 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1346315690, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:07:20 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] Created reservations ['7a99167d-0a1f-41bf-95af-6666e9deb883', 'a8c8162d-fe5c-4482-aa16-f5aa8621f27f', '85619033-88a5-4978-87ba-752c79e6386e', 'dfab46de-95ae-4fd4-8ada-2484090b4e2d'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:07:21 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5bbde675-21a6-4e93-b19f-87aa8662a479 tempest-GroupSnapshotsV319Test-1869548855 None] group_snapshot d5ee8896-336c-4e85-b274-7be4b9c1a01c: deleted successfully Sep 23 15:07:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-be1fe459-c05c-4491-9f9b-3613fa427eb9 tempest-GroupSnapshotsV319Test-1869548855 None] Acquiring lock "cinder-quobyte-fb5e129f-61ea-4510-934f-4a900049cc47" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:07:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-be1fe459-c05c-4491-9f9b-3613fa427eb9 tempest-GroupSnapshotsV319Test-1869548855 None] Lock "cinder-quobyte-fb5e129f-61ea-4510-934f-4a900049cc47" acquired by "delete_volume" :: waited 0.052s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:07:22 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7694ba6a-f67d-4941-a424-bee52061d18a]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:07:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-be1fe459-c05c-4491-9f9b-3613fa427eb9 tempest-GroupSnapshotsV319Test-1869548855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:22 devstack sudo[87282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47 Sep 23 15:07:22 devstack sudo[87282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:23 devstack sudo[87282]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-be1fe459-c05c-4491-9f9b-3613fa427eb9 tempest-GroupSnapshotsV319Test-1869548855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47" returned: 0 in 0.711s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-be1fe459-c05c-4491-9f9b-3613fa427eb9 tempest-GroupSnapshotsV319Test-1869548855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:23 devstack sudo[87298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47 Sep 23 15:07:23 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:23 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-be1fe459-c05c-4491-9f9b-3613fa427eb9 tempest-GroupSnapshotsV319Test-1869548855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb5e129f-61ea-4510-934f-4a900049cc47" returned: 0 in 0.464s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-be1fe459-c05c-4491-9f9b-3613fa427eb9 tempest-GroupSnapshotsV319Test-1869548855 None] Lock "cinder-quobyte-fb5e129f-61ea-4510-934f-4a900049cc47" released by "delete_volume" :: held 1.322s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:07:23 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-be1fe459-c05c-4491-9f9b-3613fa427eb9 tempest-GroupSnapshotsV319Test-1869548855 None] Created reservations ['8ff7190e-af82-4f13-8286-776b57b73465'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:07:23 devstack cinder-volume[86064]: WARNING cinder.quota [None req-be1fe459-c05c-4491-9f9b-3613fa427eb9 tempest-GroupSnapshotsV319Test-1869548855 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1346315690 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1346315690, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:07:23 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-be1fe459-c05c-4491-9f9b-3613fa427eb9 tempest-GroupSnapshotsV319Test-1869548855 None] Created reservations ['05ba9cb8-9653-4eed-99a3-d2f267b6b9a6', '8474e68b-a307-4b03-8d2e-81d6710c8340', '789080ab-a540-4baf-bb4f-1ee9e0c66f9a', '4b440175-9fb8-42ab-aa6b-39e765bb2e96'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:07:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-be1fe459-c05c-4491-9f9b-3613fa427eb9 tempest-GroupSnapshotsV319Test-1869548855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:07:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-be1fe459-c05c-4491-9f9b-3613fa427eb9 tempest-GroupSnapshotsV319Test-1869548855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:07:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-be1fe459-c05c-4491-9f9b-3613fa427eb9 tempest-GroupSnapshotsV319Test-1869548855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:07:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-be1fe459-c05c-4491-9f9b-3613fa427eb9 tempest-GroupSnapshotsV319Test-1869548855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:07:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-be1fe459-c05c-4491-9f9b-3613fa427eb9 tempest-GroupSnapshotsV319Test-1869548855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:07:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-be1fe459-c05c-4491-9f9b-3613fa427eb9 tempest-GroupSnapshotsV319Test-1869548855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:24 devstack sudo[87303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:07:24 devstack sudo[87303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:24 devstack sudo[87303]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-be1fe459-c05c-4491-9f9b-3613fa427eb9 tempest-GroupSnapshotsV319Test-1869548855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.616s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:24 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-be1fe459-c05c-4491-9f9b-3613fa427eb9 tempest-GroupSnapshotsV319Test-1869548855 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:07:24 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-be1fe459-c05c-4491-9f9b-3613fa427eb9 tempest-GroupSnapshotsV319Test-1869548855 None] Delete group completed successfully. Sep 23 15:07:27 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:07:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Flow 'volume_create_manager' (39b3c9ad-c27c-45d7-89a4-45ec73a22101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:07:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8262707-a220-4120-af4c-3f69bc855ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8262707-a220-4120-af4c-3f69bc855ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-538591377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329a91d1-a2ef-4342-983b-6696e725dfbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030250f1ad0e49b9bb6caa0653263c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:07:27Z,use_quota=True,user_id='b6e4f9b6fbf84e54afce01fddaa76181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8be9947-91de-43e6-8692-1a6410956653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8be9947-91de-43e6-8692-1a6410956653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (491f7ff7-3b69-45c0-9a3e-f8c448b49299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (491f7ff7-3b69-45c0-9a3e-f8c448b49299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '329a91d1-a2ef-4342-983b-6696e725dfbd', 'volume_name': 'volume-329a91d1-a2ef-4342-983b-6696e725dfbd', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb43c7e8-a91e-4a7f-af4d-52273ba16db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb43c7e8-a91e-4a7f-af4d-52273ba16db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce82bad-ae70-43b9-9fca-0f3806f76280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:27 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Volume 329a91d1-a2ef-4342-983b-6696e725dfbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-329a91d1-a2ef-4342-983b-6696e725dfbd', 'volume_size': 1} Sep 23 15:07:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:07:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:07:27 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-538591377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329a91d1-a2ef-4342-983b-6696e725dfbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030250f1ad0e49b9bb6caa0653263c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:07:27Z,use_quota=True,user_id='b6e4f9b6fbf84e54afce01fddaa76181',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:07:27 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Creating volume 329a91d1-a2ef-4342-983b-6696e725dfbd {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:07:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:07:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:07:27 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:07:27 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:07:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:07:27 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:07:27 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:07:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-329a91d1-a2ef-4342-983b-6696e725dfbd 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:27 devstack sudo[87336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-329a91d1-a2ef-4342-983b-6696e725dfbd 1073741824 Sep 23 15:07:27 devstack sudo[87336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:28 devstack sudo[87336]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-329a91d1-a2ef-4342-983b-6696e725dfbd 1073741824" returned: 0 in 0.772s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-329a91d1-a2ef-4342-983b-6696e725dfbd {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:28 devstack sudo[87346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-329a91d1-a2ef-4342-983b-6696e725dfbd Sep 23 15:07:28 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:28 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-329a91d1-a2ef-4342-983b-6696e725dfbd" returned: 0 in 0.477s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:07:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:07:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce82bad-ae70-43b9-9fca-0f3806f76280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-329a91d1-a2ef-4342-983b-6696e725dfbd', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b40f55-e82d-4077-a143-ac5ec5ec5c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:28 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Volume volume-329a91d1-a2ef-4342-983b-6696e725dfbd (329a91d1-a2ef-4342-983b-6696e725dfbd): created successfully Sep 23 15:07:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b40f55-e82d-4077-a143-ac5ec5ec5c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Flow 'volume_create_manager' (39b3c9ad-c27c-45d7-89a4-45ec73a22101) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:07:28 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-65fb2977-6b1e-4fe2-8500-d9f63587d1e0 tempest-VolumesAdminNegativeTest-1930285712 None] Created volume successfully. Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Flow 'volume_create_manager' (59cce504-b191-4302-95af-c8217db4d3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a29813-30b1-4b7a-a9e0-ec0b6572bd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a29813-30b1-4b7a-a9e0-ec0b6572bd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-767957320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db3636b5-a2d7-4fbd-b4d2-db72387576b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f99ee03d3224d37988a3f02b043860a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:07:31Z,use_quota=True,user_id='ed141cd2364e4ce0911f1964903f07e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bccf3d26-90e9-4da7-a3df-f2c95bd304cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bccf3d26-90e9-4da7-a3df-f2c95bd304cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a56a91b-a293-405b-a78a-759ce0a736a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a56a91b-a293-405b-a78a-759ce0a736a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db3636b5-a2d7-4fbd-b4d2-db72387576b6', 'volume_name': 'volume-db3636b5-a2d7-4fbd-b4d2-db72387576b6', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7397ee-31c9-4e35-9fab-9b5164969ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7397ee-31c9-4e35-9fab-9b5164969ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79335f05-1290-47d7-a781-b035757fbe02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:30 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Volume db3636b5-a2d7-4fbd-b4d2-db72387576b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db3636b5-a2d7-4fbd-b4d2-db72387576b6', 'volume_size': 1} Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-767957320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db3636b5-a2d7-4fbd-b4d2-db72387576b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f99ee03d3224d37988a3f02b043860a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:07:31Z,use_quota=True,user_id='ed141cd2364e4ce0911f1964903f07e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Creating volume db3636b5-a2d7-4fbd-b4d2-db72387576b6 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:07:30 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-db3636b5-a2d7-4fbd-b4d2-db72387576b6 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fb68a109-08be-4ff5-8729-fb1e1ae381c9 tempest-VolumesAdminNegativeTest-1930285712 None] Acquiring lock "cinder-329a91d1-a2ef-4342-983b-6696e725dfbd-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:07:30 devstack sudo[87351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-db3636b5-a2d7-4fbd-b4d2-db72387576b6 1073741824 Sep 23 15:07:30 devstack sudo[87351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fb68a109-08be-4ff5-8729-fb1e1ae381c9 tempest-VolumesAdminNegativeTest-1930285712 None] Lock "cinder-329a91d1-a2ef-4342-983b-6696e725dfbd-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:07:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fb68a109-08be-4ff5-8729-fb1e1ae381c9 tempest-VolumesAdminNegativeTest-1930285712 None] Acquiring lock "cinder-quobyte-329a91d1-a2ef-4342-983b-6696e725dfbd" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:07:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fb68a109-08be-4ff5-8729-fb1e1ae381c9 tempest-VolumesAdminNegativeTest-1930285712 None] Lock "cinder-quobyte-329a91d1-a2ef-4342-983b-6696e725dfbd" acquired by "delete_volume" :: waited 0.030s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:07:31 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4643e5-ed85-4d08-8e45-25ad67bd7a53]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:07:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb68a109-08be-4ff5-8729-fb1e1ae381c9 tempest-VolumesAdminNegativeTest-1930285712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-329a91d1-a2ef-4342-983b-6696e725dfbd {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:31 devstack sudo[87353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-329a91d1-a2ef-4342-983b-6696e725dfbd Sep 23 15:07:31 devstack sudo[87353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:31 devstack sudo[87351]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-db3636b5-a2d7-4fbd-b4d2-db72387576b6 1073741824" returned: 0 in 0.817s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-db3636b5-a2d7-4fbd-b4d2-db72387576b6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:31 devstack sudo[87361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-db3636b5-a2d7-4fbd-b4d2-db72387576b6 Sep 23 15:07:31 devstack sudo[87361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:31 devstack sudo[87353]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb68a109-08be-4ff5-8729-fb1e1ae381c9 tempest-VolumesAdminNegativeTest-1930285712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-329a91d1-a2ef-4342-983b-6696e725dfbd" returned: 0 in 0.713s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb68a109-08be-4ff5-8729-fb1e1ae381c9 tempest-VolumesAdminNegativeTest-1930285712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-329a91d1-a2ef-4342-983b-6696e725dfbd {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:31 devstack sudo[87365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-329a91d1-a2ef-4342-983b-6696e725dfbd Sep 23 15:07:31 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:32 devstack sudo[87361]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-db3636b5-a2d7-4fbd-b4d2-db72387576b6" returned: 0 in 0.532s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:07:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:07:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79335f05-1290-47d7-a781-b035757fbe02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db3636b5-a2d7-4fbd-b4d2-db72387576b6', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15fdb0de-e71f-4763-9aa5-dcda28a01800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:32 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Volume volume-db3636b5-a2d7-4fbd-b4d2-db72387576b6 (db3636b5-a2d7-4fbd-b4d2-db72387576b6): created successfully Sep 23 15:07:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15fdb0de-e71f-4763-9aa5-dcda28a01800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Flow 'volume_create_manager' (59cce504-b191-4302-95af-c8217db4d3e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:07:32 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-fe760e78-ce09-4ca3-91fe-0e6f857bf10d tempest-ServersNegativeTestJSON-877093913 None] Created volume successfully. Sep 23 15:07:32 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb68a109-08be-4ff5-8729-fb1e1ae381c9 tempest-VolumesAdminNegativeTest-1930285712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-329a91d1-a2ef-4342-983b-6696e725dfbd" returned: 0 in 0.528s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fb68a109-08be-4ff5-8729-fb1e1ae381c9 tempest-VolumesAdminNegativeTest-1930285712 None] Lock "cinder-quobyte-329a91d1-a2ef-4342-983b-6696e725dfbd" released by "delete_volume" :: held 1.378s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:07:32 devstack cinder-volume[86064]: WARNING cinder.quota [None req-fb68a109-08be-4ff5-8729-fb1e1ae381c9 tempest-VolumesAdminNegativeTest-1930285712 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:07:32 devstack cinder-volume[86064]: WARNING cinder.quota [None req-fb68a109-08be-4ff5-8729-fb1e1ae381c9 tempest-VolumesAdminNegativeTest-1930285712 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:07:32 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-fb68a109-08be-4ff5-8729-fb1e1ae381c9 tempest-VolumesAdminNegativeTest-1930285712 None] Created reservations ['3c549aae-d995-43f8-b3de-3c4e659e7c09', 'b490100f-c5bb-4dc8-b313-8760f566db05', '3474c86b-974e-4dd7-aec2-15ed7279c281', '29be2601-9408-4b70-b323-5d95bcfdc69e'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:07:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb68a109-08be-4ff5-8729-fb1e1ae381c9 tempest-VolumesAdminNegativeTest-1930285712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:07:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb68a109-08be-4ff5-8729-fb1e1ae381c9 tempest-VolumesAdminNegativeTest-1930285712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:07:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb68a109-08be-4ff5-8729-fb1e1ae381c9 tempest-VolumesAdminNegativeTest-1930285712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:07:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb68a109-08be-4ff5-8729-fb1e1ae381c9 tempest-VolumesAdminNegativeTest-1930285712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:07:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb68a109-08be-4ff5-8729-fb1e1ae381c9 tempest-VolumesAdminNegativeTest-1930285712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:07:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb68a109-08be-4ff5-8729-fb1e1ae381c9 tempest-VolumesAdminNegativeTest-1930285712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:32 devstack sudo[87369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:07:32 devstack sudo[87369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:33 devstack sudo[87369]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb68a109-08be-4ff5-8729-fb1e1ae381c9 tempest-VolumesAdminNegativeTest-1930285712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.410s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:33 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb68a109-08be-4ff5-8729-fb1e1ae381c9 tempest-VolumesAdminNegativeTest-1930285712 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:07:33 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-fb68a109-08be-4ff5-8729-fb1e1ae381c9 tempest-VolumesAdminNegativeTest-1930285712 None] Deleted volume successfully. Sep 23 15:07:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fb68a109-08be-4ff5-8729-fb1e1ae381c9 tempest-VolumesAdminNegativeTest-1930285712 None] Lock "cinder-329a91d1-a2ef-4342-983b-6696e725dfbd-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Flow 'volume_create_manager' (01ccc3c9-244c-483d-9aef-1e736a84263c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b5aea4-802c-4647-8341-1c022b18dd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b5aea4-802c-4647-8341-1c022b18dd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1402353271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b63874-160c-4b56-8d5f-df127dc2052d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f99ee03d3224d37988a3f02b043860a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:07:35Z,use_quota=True,user_id='ed141cd2364e4ce0911f1964903f07e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd12121-38a4-41d8-9937-d43bf930ecd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd12121-38a4-41d8-9937-d43bf930ecd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c200e904-a91a-404c-b7c5-74632b73d48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c200e904-a91a-404c-b7c5-74632b73d48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0b63874-160c-4b56-8d5f-df127dc2052d', 'volume_name': 'volume-b0b63874-160c-4b56-8d5f-df127dc2052d', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9047a482-374a-4145-832f-1b3330a84876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9047a482-374a-4145-832f-1b3330a84876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cada2c3b-a2b3-4369-95c0-6563c51a8d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:35 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Volume b0b63874-160c-4b56-8d5f-df127dc2052d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0b63874-160c-4b56-8d5f-df127dc2052d', 'volume_size': 1} Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1402353271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b63874-160c-4b56-8d5f-df127dc2052d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f99ee03d3224d37988a3f02b043860a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:07:35Z,use_quota=True,user_id='ed141cd2364e4ce0911f1964903f07e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Creating volume b0b63874-160c-4b56-8d5f-df127dc2052d {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:07:35 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b0b63874-160c-4b56-8d5f-df127dc2052d 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:35 devstack sudo[87397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b0b63874-160c-4b56-8d5f-df127dc2052d 1073741824 Sep 23 15:07:35 devstack sudo[87397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:35 devstack sudo[87397]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b0b63874-160c-4b56-8d5f-df127dc2052d 1073741824" returned: 0 in 0.675s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b0b63874-160c-4b56-8d5f-df127dc2052d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:07:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:07:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:07:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:07:36 devstack sudo[87406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b0b63874-160c-4b56-8d5f-df127dc2052d Sep 23 15:07:36 devstack sudo[87406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:07:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:07:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:36 devstack sudo[87408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:07:36 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:36 devstack sudo[87406]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b0b63874-160c-4b56-8d5f-df127dc2052d" returned: 0 in 0.322s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:07:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:07:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cada2c3b-a2b3-4369-95c0-6563c51a8d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0b63874-160c-4b56-8d5f-df127dc2052d', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340c2e7d-8a53-4d8a-901e-a9dd3c621ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:36 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Volume volume-b0b63874-160c-4b56-8d5f-df127dc2052d (b0b63874-160c-4b56-8d5f-df127dc2052d): created successfully Sep 23 15:07:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340c2e7d-8a53-4d8a-901e-a9dd3c621ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Flow 'volume_create_manager' (01ccc3c9-244c-483d-9aef-1e736a84263c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:07:36 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f2b2edb7-ba23-4167-ad2f-59cb934a7573 tempest-ServersNegativeTestJSON-877093913 None] Created volume successfully. Sep 23 15:07:36 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.404s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:07:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:07:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 8 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:07:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:07:37 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:07:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Flow 'volume_create_manager' (ffc10e46-a621-443c-812f-5a99507851aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:07:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4003132b-753f-49a6-9b5f-daa07a549823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4003132b-753f-49a6-9b5f-daa07a549823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1539517128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd6be29-0444-4b61-a1d9-041c2d58604d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc64c7b4459482eaa492dc2cfd08690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:07:37Z,use_quota=True,user_id='14e46eaef49f4b7f8189a7225816400f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4660303-ecd1-433f-acb2-ff1de1243bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4660303-ecd1-433f-acb2-ff1de1243bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c4eb0b-b0a1-4185-ae5f-1592da05b632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c4eb0b-b0a1-4185-ae5f-1592da05b632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fd6be29-0444-4b61-a1d9-041c2d58604d', 'volume_name': 'volume-0fd6be29-0444-4b61-a1d9-041c2d58604d', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362a3357-7ceb-43c7-a2bd-32d63e976f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362a3357-7ceb-43c7-a2bd-32d63e976f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a189930c-0196-4638-8c12-5ccc94178f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:37 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Volume 0fd6be29-0444-4b61-a1d9-041c2d58604d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fd6be29-0444-4b61-a1d9-041c2d58604d', 'volume_size': 1} Sep 23 15:07:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:07:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:07:37 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1539517128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd6be29-0444-4b61-a1d9-041c2d58604d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc64c7b4459482eaa492dc2cfd08690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:07:37Z,use_quota=True,user_id='14e46eaef49f4b7f8189a7225816400f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:07:37 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Creating volume 0fd6be29-0444-4b61-a1d9-041c2d58604d {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:07:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:07:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:07:37 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:07:37 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:07:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:07:37 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:07:37 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:07:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:37 devstack sudo[87413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d 1073741824 Sep 23 15:07:37 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:38 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d 1073741824" returned: 0 in 0.593s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:38 devstack sudo[87419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d Sep 23 15:07:38 devstack sudo[87419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:38 devstack sudo[87419]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d" returned: 0 in 0.300s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:07:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:07:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a189930c-0196-4638-8c12-5ccc94178f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd6be29-0444-4b61-a1d9-041c2d58604d', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc8390d-e980-4537-9ccf-19076287ff07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:07:38 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Volume volume-0fd6be29-0444-4b61-a1d9-041c2d58604d (0fd6be29-0444-4b61-a1d9-041c2d58604d): created successfully Sep 23 15:07:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc8390d-e980-4537-9ccf-19076287ff07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:07:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Flow 'volume_create_manager' (ffc10e46-a621-443c-812f-5a99507851aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:07:38 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-27ee8a80-b2b1-4731-aede-ae0bb60b4d7f tempest-SnapshotsActionsTest-1693360100 None] Created volume successfully. Sep 23 15:07:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-45c09661-420c-4b09-82c6-8515f3f6cbf7 tempest-SnapshotsActionsTest-1693360100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:07:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-45c09661-420c-4b09-82c6-8515f3f6cbf7 tempest-SnapshotsActionsTest-1693360100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:07:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-45c09661-420c-4b09-82c6-8515f3f6cbf7 tempest-SnapshotsActionsTest-1693360100 None] Creating offline snapshot 1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc of volume 0fd6be29-0444-4b61-a1d9-041c2d58604d {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:07:39 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5158b560-9dc7-4c1e-94c2-a0e0746ee650]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:07:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-45c09661-420c-4b09-82c6-8515f3f6cbf7 tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:40 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d Sep 23 15:07:40 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:40 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-45c09661-420c-4b09-82c6-8515f3f6cbf7 tempest-SnapshotsActionsTest-1693360100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d" returned: 0 in 0.388s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-45c09661-420c-4b09-82c6-8515f3f6cbf7 tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:40 devstack sudo[87428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc 1G Sep 23 15:07:40 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:40 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-45c09661-420c-4b09-82c6-8515f3f6cbf7 tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc 1G" returned: 0 in 0.545s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-45c09661-420c-4b09-82c6-8515f3f6cbf7 tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd6be29-0444-4b61-a1d9-041c2d58604d -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:40 devstack sudo[87435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd6be29-0444-4b61-a1d9-041c2d58604d -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc Sep 23 15:07:40 devstack sudo[87435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:41 devstack sudo[87435]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-45c09661-420c-4b09-82c6-8515f3f6cbf7 tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd6be29-0444-4b61-a1d9-041c2d58604d -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc" returned: 0 in 0.383s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:41 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-45c09661-420c-4b09-82c6-8515f3f6cbf7 tempest-SnapshotsActionsTest-1693360100 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc is being set with open permissions: ugo+rw Sep 23 15:07:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-45c09661-420c-4b09-82c6-8515f3f6cbf7 tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:41 devstack sudo[87441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc Sep 23 15:07:41 devstack sudo[87441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:41 devstack sudo[87441]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-45c09661-420c-4b09-82c6-8515f3f6cbf7 tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc" returned: 0 in 0.337s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-473884f4-a511-40d9-b368-de9703f50870 tempest-ServersNegativeTestJSON-877093913 None] Acquiring lock "cinder-b0b63874-160c-4b56-8d5f-df127dc2052d-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:07:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-45c09661-420c-4b09-82c6-8515f3f6cbf7 tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-473884f4-a511-40d9-b368-de9703f50870 tempest-ServersNegativeTestJSON-877093913 None] Lock "cinder-b0b63874-160c-4b56-8d5f-df127dc2052d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:07:41 devstack sudo[87444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.info Sep 23 15:07:41 devstack sudo[87444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-473884f4-a511-40d9-b368-de9703f50870 tempest-ServersNegativeTestJSON-877093913 None] Acquiring lock "cinder-quobyte-b0b63874-160c-4b56-8d5f-df127dc2052d" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:07:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-473884f4-a511-40d9-b368-de9703f50870 tempest-ServersNegativeTestJSON-877093913 None] Lock "cinder-quobyte-b0b63874-160c-4b56-8d5f-df127dc2052d" acquired by "delete_volume" :: waited 0.021s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:07:41 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cee6bb6-d224-4c82-99d2-e2ff11593689]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:07:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-473884f4-a511-40d9-b368-de9703f50870 tempest-ServersNegativeTestJSON-877093913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b0b63874-160c-4b56-8d5f-df127dc2052d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:41 devstack sudo[87446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b0b63874-160c-4b56-8d5f-df127dc2052d Sep 23 15:07:41 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:42 devstack sudo[87444]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-45c09661-420c-4b09-82c6-8515f3f6cbf7 tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.info" returned: 0 in 0.419s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:42 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-45c09661-420c-4b09-82c6-8515f3f6cbf7 tempest-SnapshotsActionsTest-1693360100 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.info is being set with open permissions: ugo+rw Sep 23 15:07:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-45c09661-420c-4b09-82c6-8515f3f6cbf7 tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:42 devstack sudo[87449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.info Sep 23 15:07:42 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:42 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-473884f4-a511-40d9-b368-de9703f50870 tempest-ServersNegativeTestJSON-877093913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b0b63874-160c-4b56-8d5f-df127dc2052d" returned: 0 in 0.523s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-473884f4-a511-40d9-b368-de9703f50870 tempest-ServersNegativeTestJSON-877093913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b0b63874-160c-4b56-8d5f-df127dc2052d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:42 devstack sudo[87454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b0b63874-160c-4b56-8d5f-df127dc2052d Sep 23 15:07:42 devstack sudo[87454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:42 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-45c09661-420c-4b09-82c6-8515f3f6cbf7 tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.info" returned: 0 in 0.370s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-45c09661-420c-4b09-82c6-8515f3f6cbf7 tempest-SnapshotsActionsTest-1693360100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.612s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:07:42 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-45c09661-420c-4b09-82c6-8515f3f6cbf7 tempest-SnapshotsActionsTest-1693360100 None] Create snapshot completed successfully Sep 23 15:07:42 devstack sudo[87454]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-473884f4-a511-40d9-b368-de9703f50870 tempest-ServersNegativeTestJSON-877093913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b0b63874-160c-4b56-8d5f-df127dc2052d" returned: 0 in 0.407s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:42 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-473884f4-a511-40d9-b368-de9703f50870 tempest-ServersNegativeTestJSON-877093913 None] Lock "cinder-quobyte-b0b63874-160c-4b56-8d5f-df127dc2052d" released by "delete_volume" :: held 1.021s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:07:42 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-473884f4-a511-40d9-b368-de9703f50870 tempest-ServersNegativeTestJSON-877093913 None] Created reservations ['09213fb2-88af-4038-be6c-70d3170dd6eb', 'b00899ec-ee39-4100-868e-2de682523e6b', '58ca63ba-cf78-4036-bc88-e484d6147c3f', '37a93127-5303-4402-bac7-3110c2703456'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:07:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-473884f4-a511-40d9-b368-de9703f50870 tempest-ServersNegativeTestJSON-877093913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:07:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-473884f4-a511-40d9-b368-de9703f50870 tempest-ServersNegativeTestJSON-877093913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:07:42 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-473884f4-a511-40d9-b368-de9703f50870 tempest-ServersNegativeTestJSON-877093913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:07:42 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-473884f4-a511-40d9-b368-de9703f50870 tempest-ServersNegativeTestJSON-877093913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:07:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-473884f4-a511-40d9-b368-de9703f50870 tempest-ServersNegativeTestJSON-877093913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:07:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-473884f4-a511-40d9-b368-de9703f50870 tempest-ServersNegativeTestJSON-877093913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:42 devstack sudo[87458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:07:42 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9a599f12-9a9c-431e-9f52-2103d7cf9cd7 tempest-ServersNegativeTestJSON-877093913 None] Acquiring lock "cinder-db3636b5-a2d7-4fbd-b4d2-db72387576b6-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:07:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9a599f12-9a9c-431e-9f52-2103d7cf9cd7 tempest-ServersNegativeTestJSON-877093913 None] Lock "cinder-db3636b5-a2d7-4fbd-b4d2-db72387576b6-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:07:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9a599f12-9a9c-431e-9f52-2103d7cf9cd7 tempest-ServersNegativeTestJSON-877093913 None] Acquiring lock "cinder-quobyte-db3636b5-a2d7-4fbd-b4d2-db72387576b6" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:07:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9a599f12-9a9c-431e-9f52-2103d7cf9cd7 tempest-ServersNegativeTestJSON-877093913 None] Lock "cinder-quobyte-db3636b5-a2d7-4fbd-b4d2-db72387576b6" acquired by "delete_volume" :: waited 0.029s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:07:43 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-473884f4-a511-40d9-b368-de9703f50870 tempest-ServersNegativeTestJSON-877093913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.422s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:43 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-473884f4-a511-40d9-b368-de9703f50870 tempest-ServersNegativeTestJSON-877093913 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:07:43 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a87693d-8b24-461a-8bf1-497dac431aaf]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:07:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9a599f12-9a9c-431e-9f52-2103d7cf9cd7 tempest-ServersNegativeTestJSON-877093913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-db3636b5-a2d7-4fbd-b4d2-db72387576b6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:43 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-473884f4-a511-40d9-b368-de9703f50870 tempest-ServersNegativeTestJSON-877093913 None] Deleted volume successfully. Sep 23 15:07:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-473884f4-a511-40d9-b368-de9703f50870 tempest-ServersNegativeTestJSON-877093913 None] Lock "cinder-b0b63874-160c-4b56-8d5f-df127dc2052d-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:07:43 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-db3636b5-a2d7-4fbd-b4d2-db72387576b6 Sep 23 15:07:43 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:43 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9a599f12-9a9c-431e-9f52-2103d7cf9cd7 tempest-ServersNegativeTestJSON-877093913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-db3636b5-a2d7-4fbd-b4d2-db72387576b6" returned: 0 in 0.602s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9a599f12-9a9c-431e-9f52-2103d7cf9cd7 tempest-ServersNegativeTestJSON-877093913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-db3636b5-a2d7-4fbd-b4d2-db72387576b6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:43 devstack sudo[87467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-db3636b5-a2d7-4fbd-b4d2-db72387576b6 Sep 23 15:07:43 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2943d689-455e-4a3f-86c4-9a634d5538a1 tempest-SnapshotsActionsTest-1693360100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:07:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2943d689-455e-4a3f-86c4-9a634d5538a1 tempest-SnapshotsActionsTest-1693360100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:07:44 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-2943d689-455e-4a3f-86c4-9a634d5538a1 tempest-SnapshotsActionsTest-1693360100 None] Creating offline snapshot 50b0e267-2292-4001-a0cb-bd47f16fb208 of volume 0fd6be29-0444-4b61-a1d9-041c2d58604d {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:07:44 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9caf51b-14ed-47dd-a3a8-338f3a3d4fab]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:07:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2943d689-455e-4a3f-86c4-9a634d5538a1 tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:44 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9a599f12-9a9c-431e-9f52-2103d7cf9cd7 tempest-ServersNegativeTestJSON-877093913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-db3636b5-a2d7-4fbd-b4d2-db72387576b6" returned: 0 in 0.371s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:44 devstack sudo[87469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc Sep 23 15:07:44 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:44 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9a599f12-9a9c-431e-9f52-2103d7cf9cd7 tempest-ServersNegativeTestJSON-877093913 None] Lock "cinder-quobyte-db3636b5-a2d7-4fbd-b4d2-db72387576b6" released by "delete_volume" :: held 1.047s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:07:44 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-9a599f12-9a9c-431e-9f52-2103d7cf9cd7 tempest-ServersNegativeTestJSON-877093913 None] Created reservations ['3bc1a7fc-753c-4d81-9c2f-63a3f9b4878d', 'f3dcc56f-01b8-47e3-8ef0-7458e8d90c70', 'f0801683-f702-4d51-ab7a-54583011449f', '920948ba-6255-402f-a77c-279716dfb454'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:07:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9a599f12-9a9c-431e-9f52-2103d7cf9cd7 tempest-ServersNegativeTestJSON-877093913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:07:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9a599f12-9a9c-431e-9f52-2103d7cf9cd7 tempest-ServersNegativeTestJSON-877093913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:07:44 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9a599f12-9a9c-431e-9f52-2103d7cf9cd7 tempest-ServersNegativeTestJSON-877093913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:07:44 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9a599f12-9a9c-431e-9f52-2103d7cf9cd7 tempest-ServersNegativeTestJSON-877093913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:07:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9a599f12-9a9c-431e-9f52-2103d7cf9cd7 tempest-ServersNegativeTestJSON-877093913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:07:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9a599f12-9a9c-431e-9f52-2103d7cf9cd7 tempest-ServersNegativeTestJSON-877093913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:44 devstack sudo[87472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:07:44 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:44 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2943d689-455e-4a3f-86c4-9a634d5538a1 tempest-SnapshotsActionsTest-1693360100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc" returned: 0 in 0.503s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:44 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-2943d689-455e-4a3f-86c4-9a634d5538a1 tempest-SnapshotsActionsTest-1693360100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd6be29-0444-4b61-a1d9-041c2d58604d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:07:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2943d689-455e-4a3f-86c4-9a634d5538a1 tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.50b0e267-2292-4001-a0cb-bd47f16fb208 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:44 devstack sudo[87477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.50b0e267-2292-4001-a0cb-bd47f16fb208 1G Sep 23 15:07:44 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:44 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9a599f12-9a9c-431e-9f52-2103d7cf9cd7 tempest-ServersNegativeTestJSON-877093913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.335s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:44 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-9a599f12-9a9c-431e-9f52-2103d7cf9cd7 tempest-ServersNegativeTestJSON-877093913 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:07:44 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-9a599f12-9a9c-431e-9f52-2103d7cf9cd7 tempest-ServersNegativeTestJSON-877093913 None] Deleted volume successfully. Sep 23 15:07:44 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9a599f12-9a9c-431e-9f52-2103d7cf9cd7 tempest-ServersNegativeTestJSON-877093913 None] Lock "cinder-db3636b5-a2d7-4fbd-b4d2-db72387576b6-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:07:45 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2943d689-455e-4a3f-86c4-9a634d5538a1 tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.50b0e267-2292-4001-a0cb-bd47f16fb208 1G" returned: 0 in 0.629s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2943d689-455e-4a3f-86c4-9a634d5538a1 tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.50b0e267-2292-4001-a0cb-bd47f16fb208 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:45 devstack sudo[87484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.50b0e267-2292-4001-a0cb-bd47f16fb208 Sep 23 15:07:45 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:45 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2943d689-455e-4a3f-86c4-9a634d5538a1 tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.50b0e267-2292-4001-a0cb-bd47f16fb208" returned: 0 in 0.452s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:45 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-2943d689-455e-4a3f-86c4-9a634d5538a1 tempest-SnapshotsActionsTest-1693360100 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.50b0e267-2292-4001-a0cb-bd47f16fb208 is being set with open permissions: ugo+rw Sep 23 15:07:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2943d689-455e-4a3f-86c4-9a634d5538a1 tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.50b0e267-2292-4001-a0cb-bd47f16fb208 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:45 devstack sudo[87490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.50b0e267-2292-4001-a0cb-bd47f16fb208 Sep 23 15:07:45 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:46 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2943d689-455e-4a3f-86c4-9a634d5538a1 tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.50b0e267-2292-4001-a0cb-bd47f16fb208" returned: 0 in 0.330s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2943d689-455e-4a3f-86c4-9a634d5538a1 tempest-SnapshotsActionsTest-1693360100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.053s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:07:46 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-2943d689-455e-4a3f-86c4-9a634d5538a1 tempest-SnapshotsActionsTest-1693360100 None] Create snapshot completed successfully Sep 23 15:07:47 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] Acquiring lock "cinder-50b0e267-2292-4001-a0cb-bd47f16fb208-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:07:47 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-50b0e267-2292-4001-a0cb-bd47f16fb208-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:07:47 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] Acquiring lock "cinder-quobyte-0fd6be29-0444-4b61-a1d9-041c2d58604d" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:07:47 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-quobyte-0fd6be29-0444-4b61-a1d9-041c2d58604d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:07:47 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] Acquiring lock "cinder-quobyte-50b0e267-2292-4001-a0cb-bd47f16fb208" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:07:47 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-quobyte-50b0e267-2292-4001-a0cb-bd47f16fb208" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:07:47 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] Deleting offline snapshot 50b0e267-2292-4001-a0cb-bd47f16fb208 of volume 0fd6be29-0444-4b61-a1d9-041c2d58604d {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:07:47 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] snapshot_file for this snap is: volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.50b0e267-2292-4001-a0cb-bd47f16fb208 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:07:47 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a530bdd-6aef-4952-a87a-5f4810d0bf5f]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:07:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.50b0e267-2292-4001-a0cb-bd47f16fb208 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:47 devstack sudo[87517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.50b0e267-2292-4001-a0cb-bd47f16fb208 Sep 23 15:07:47 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:48 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.50b0e267-2292-4001-a0cb-bd47f16fb208" returned: 0 in 0.465s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd6be29-0444-4b61-a1d9-041c2d58604d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:07:48 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3338b41f-446a-4067-93b3-adc03beab04a]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:07:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:48 devstack sudo[87522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc Sep 23 15:07:48 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:48 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc" returned: 0 in 0.511s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd6be29-0444-4b61-a1d9-041c2d58604d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:07:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.50b0e267-2292-4001-a0cb-bd47f16fb208 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:48 devstack sudo[87531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.50b0e267-2292-4001-a0cb-bd47f16fb208 Sep 23 15:07:48 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:49 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.50b0e267-2292-4001-a0cb-bd47f16fb208" returned: 0 in 0.601s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.50b0e267-2292-4001-a0cb-bd47f16fb208 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:49 devstack sudo[87539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.50b0e267-2292-4001-a0cb-bd47f16fb208 Sep 23 15:07:49 devstack sudo[87539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:49 devstack sudo[87539]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.50b0e267-2292-4001-a0cb-bd47f16fb208" returned: 0 in 0.259s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-quobyte-50b0e267-2292-4001-a0cb-bd47f16fb208" released by "_delete_snapshot" :: held 1.981s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:07:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-quobyte-0fd6be29-0444-4b61-a1d9-041c2d58604d" released by "delete_snapshot" :: held 2.013s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:07:49 devstack cinder-volume[86064]: WARNING cinder.quota [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:07:49 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] Created reservations ['5a2881f2-ce32-4ae5-a62e-2b0efe12afbb', '337b4540-ed05-4443-bd7e-438e54d99686', 'f5519a70-45c4-4389-a5c4-b1878b730663', 'a74aa4f5-ba33-493f-a846-896be5191c9c'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:07:49 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] Delete snapshot completed successfully. Sep 23 15:07:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8798e873-479a-48c3-a11d-c9e3336a1fa4 tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-50b0e267-2292-4001-a0cb-bd47f16fb208-delete_snapshot" released by "delete_snapshot" :: held 2.208s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:07:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-69accdc9-05b3-4cb8-a769-8a372084d413 tempest-SnapshotsActionsTest-1693360100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:07:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-69accdc9-05b3-4cb8-a769-8a372084d413 tempest-SnapshotsActionsTest-1693360100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:07:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-69accdc9-05b3-4cb8-a769-8a372084d413 tempest-SnapshotsActionsTest-1693360100 None] Creating offline snapshot a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6 of volume 0fd6be29-0444-4b61-a1d9-041c2d58604d {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:07:51 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a11dd6-3aae-4fdf-a6da-18b56da5ccb5]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:07:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-69accdc9-05b3-4cb8-a769-8a372084d413 tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:51 devstack sudo[87550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc Sep 23 15:07:51 devstack sudo[87550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:51 devstack sudo[87550]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-69accdc9-05b3-4cb8-a769-8a372084d413 tempest-SnapshotsActionsTest-1693360100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc" returned: 0 in 0.549s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-69accdc9-05b3-4cb8-a769-8a372084d413 tempest-SnapshotsActionsTest-1693360100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd6be29-0444-4b61-a1d9-041c2d58604d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:07:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-69accdc9-05b3-4cb8-a769-8a372084d413 tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:51 devstack sudo[87558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6 1G Sep 23 15:07:51 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:52 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-69accdc9-05b3-4cb8-a769-8a372084d413 tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6 1G" returned: 0 in 0.609s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-69accdc9-05b3-4cb8-a769-8a372084d413 tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:52 devstack sudo[87566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6 Sep 23 15:07:52 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:52 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-69accdc9-05b3-4cb8-a769-8a372084d413 tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6" returned: 0 in 0.377s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:52 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-69accdc9-05b3-4cb8-a769-8a372084d413 tempest-SnapshotsActionsTest-1693360100 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6 is being set with open permissions: ugo+rw Sep 23 15:07:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-69accdc9-05b3-4cb8-a769-8a372084d413 tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:52 devstack sudo[87582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6 Sep 23 15:07:52 devstack sudo[87582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:53 devstack sudo[87582]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-69accdc9-05b3-4cb8-a769-8a372084d413 tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6" returned: 0 in 0.248s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-69accdc9-05b3-4cb8-a769-8a372084d413 tempest-SnapshotsActionsTest-1693360100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.903s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:07:53 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-69accdc9-05b3-4cb8-a769-8a372084d413 tempest-SnapshotsActionsTest-1693360100 None] Create snapshot completed successfully Sep 23 15:07:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] Acquiring lock "cinder-a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:07:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:07:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] Acquiring lock "cinder-quobyte-0fd6be29-0444-4b61-a1d9-041c2d58604d" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:07:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-quobyte-0fd6be29-0444-4b61-a1d9-041c2d58604d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:07:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] Acquiring lock "cinder-quobyte-a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:07:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-quobyte-a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:07:53 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] Deleting offline snapshot a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6 of volume 0fd6be29-0444-4b61-a1d9-041c2d58604d {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:07:53 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] snapshot_file for this snap is: volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:07:53 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff214806-da77-46b3-879c-ff2f72758439]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:07:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:53 devstack sudo[87592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6 Sep 23 15:07:53 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:53 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6" returned: 0 in 0.385s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:53 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd6be29-0444-4b61-a1d9-041c2d58604d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:07:53 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa180ad1-8036-4ad0-ab10-ec85bcef47fc]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:07:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:54 devstack sudo[87598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc Sep 23 15:07:54 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:54 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc" returned: 0 in 0.499s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd6be29-0444-4b61-a1d9-041c2d58604d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:07:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:54 devstack sudo[87603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6 Sep 23 15:07:54 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:54 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6" returned: 0 in 0.409s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:54 devstack sudo[87609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6 Sep 23 15:07:54 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:55 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6" returned: 0 in 0.250s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:55 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-quobyte-a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6" released by "_delete_snapshot" :: held 1.684s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:07:55 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-quobyte-0fd6be29-0444-4b61-a1d9-041c2d58604d" released by "delete_snapshot" :: held 1.715s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:07:55 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] Created reservations ['3276bb74-4743-49f3-8d6c-31bfba95c230', '8fc1b912-0b14-4091-85ab-14dfa32ac012', 'b7a6f233-dc8b-4394-8f44-d7a1d6b6700a', '9344cb82-4b42-4253-955a-c1221c7963f8'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:07:55 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] Delete snapshot completed successfully. Sep 23 15:07:55 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-74319dbc-f4e5-4dc6-8e6f-ef4002ff6cc1 tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-a928c64c-64ee-42a6-a33d-cfdd5b9cdaa6-delete_snapshot" released by "delete_snapshot" :: held 1.867s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:07:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e4ac3137-2f01-41ae-9064-9351df04b50c tempest-SnapshotsActionsTest-1693360100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:07:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e4ac3137-2f01-41ae-9064-9351df04b50c tempest-SnapshotsActionsTest-1693360100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:07:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-e4ac3137-2f01-41ae-9064-9351df04b50c tempest-SnapshotsActionsTest-1693360100 None] Creating offline snapshot 8e678a9d-47c0-4b45-9c8e-f012fc39fd49 of volume 0fd6be29-0444-4b61-a1d9-041c2d58604d {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:07:56 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdebf41-8886-4666-91f3-696b3d347cf2]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:07:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e4ac3137-2f01-41ae-9064-9351df04b50c tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:56 devstack sudo[87613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc Sep 23 15:07:56 devstack sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:56 devstack sudo[87613]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e4ac3137-2f01-41ae-9064-9351df04b50c tempest-SnapshotsActionsTest-1693360100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc" returned: 0 in 0.440s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-e4ac3137-2f01-41ae-9064-9351df04b50c tempest-SnapshotsActionsTest-1693360100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd6be29-0444-4b61-a1d9-041c2d58604d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:07:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e4ac3137-2f01-41ae-9064-9351df04b50c tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.8e678a9d-47c0-4b45-9c8e-f012fc39fd49 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:56 devstack sudo[87618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.8e678a9d-47c0-4b45-9c8e-f012fc39fd49 1G Sep 23 15:07:56 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:57 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e4ac3137-2f01-41ae-9064-9351df04b50c tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.8e678a9d-47c0-4b45-9c8e-f012fc39fd49 1G" returned: 0 in 0.616s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e4ac3137-2f01-41ae-9064-9351df04b50c tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.8e678a9d-47c0-4b45-9c8e-f012fc39fd49 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:57 devstack sudo[87625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.8e678a9d-47c0-4b45-9c8e-f012fc39fd49 Sep 23 15:07:57 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:57 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e4ac3137-2f01-41ae-9064-9351df04b50c tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.8e678a9d-47c0-4b45-9c8e-f012fc39fd49" returned: 0 in 0.343s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:57 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-e4ac3137-2f01-41ae-9064-9351df04b50c tempest-SnapshotsActionsTest-1693360100 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.8e678a9d-47c0-4b45-9c8e-f012fc39fd49 is being set with open permissions: ugo+rw Sep 23 15:07:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e4ac3137-2f01-41ae-9064-9351df04b50c tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.8e678a9d-47c0-4b45-9c8e-f012fc39fd49 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:57 devstack sudo[87631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.8e678a9d-47c0-4b45-9c8e-f012fc39fd49 Sep 23 15:07:57 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:57 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e4ac3137-2f01-41ae-9064-9351df04b50c tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.8e678a9d-47c0-4b45-9c8e-f012fc39fd49" returned: 0 in 0.352s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:57 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=62,cinder:UPDATE=73,cinder:DELETE=7,cinder:INSERT=13 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:07:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e4ac3137-2f01-41ae-9064-9351df04b50c tempest-SnapshotsActionsTest-1693360100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.902s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:07:57 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-e4ac3137-2f01-41ae-9064-9351df04b50c tempest-SnapshotsActionsTest-1693360100 None] Create snapshot completed successfully Sep 23 15:07:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] Acquiring lock "cinder-8e678a9d-47c0-4b45-9c8e-f012fc39fd49-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:07:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-8e678a9d-47c0-4b45-9c8e-f012fc39fd49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:07:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] Acquiring lock "cinder-quobyte-0fd6be29-0444-4b61-a1d9-041c2d58604d" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:07:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-quobyte-0fd6be29-0444-4b61-a1d9-041c2d58604d" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:07:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] Acquiring lock "cinder-quobyte-8e678a9d-47c0-4b45-9c8e-f012fc39fd49" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:07:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-quobyte-8e678a9d-47c0-4b45-9c8e-f012fc39fd49" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:07:58 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] Deleting offline snapshot 8e678a9d-47c0-4b45-9c8e-f012fc39fd49 of volume 0fd6be29-0444-4b61-a1d9-041c2d58604d {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:07:58 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] snapshot_file for this snap is: volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.8e678a9d-47c0-4b45-9c8e-f012fc39fd49 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:07:58 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cd5aa9-03d1-4a1a-a35a-276c6661f5de]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:07:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.8e678a9d-47c0-4b45-9c8e-f012fc39fd49 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:58 devstack sudo[87648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.8e678a9d-47c0-4b45-9c8e-f012fc39fd49 Sep 23 15:07:58 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:07:59 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root Sep 23 15:07:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.8e678a9d-47c0-4b45-9c8e-f012fc39fd49" returned: 0 in 0.886s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:07:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd6be29-0444-4b61-a1d9-041c2d58604d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:07:59 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[01118bff-5582-46ff-aa6c-8a8114aecf5f]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:07:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:07:59 devstack sudo[87704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc Sep 23 15:07:59 devstack sudo[87704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:00 devstack sudo[87704]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc" returned: 0 in 0.732s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd6be29-0444-4b61-a1d9-041c2d58604d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:08:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.8e678a9d-47c0-4b45-9c8e-f012fc39fd49 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:00 devstack sudo[87713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.8e678a9d-47c0-4b45-9c8e-f012fc39fd49 Sep 23 15:08:00 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:01 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.8e678a9d-47c0-4b45-9c8e-f012fc39fd49" returned: 0 in 0.881s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.8e678a9d-47c0-4b45-9c8e-f012fc39fd49 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:01 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.8e678a9d-47c0-4b45-9c8e-f012fc39fd49 Sep 23 15:08:01 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:01 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.8e678a9d-47c0-4b45-9c8e-f012fc39fd49" returned: 0 in 0.528s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:01 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-quobyte-8e678a9d-47c0-4b45-9c8e-f012fc39fd49" released by "_delete_snapshot" :: held 3.383s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:08:01 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-quobyte-0fd6be29-0444-4b61-a1d9-041c2d58604d" released by "delete_snapshot" :: held 3.443s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:08:01 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=74,cinder:UPDATE=76,cinder:INSERT=23,cinder:DELETE=5 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:08:01 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] Created reservations ['be139843-e88a-4a64-ab8e-cfa972044107', '6ebc3533-56ea-4945-a0e4-22857a479275', '034402bf-311a-434c-8ec7-2465b0100f2f', '55761abf-8afe-47ab-8f21-b019863b2411'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:08:02 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] Delete snapshot completed successfully. Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-85420fc1-1749-4275-823f-3c7984e4c66b tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-8e678a9d-47c0-4b45-9c8e-f012fc39fd49-delete_snapshot" released by "delete_snapshot" :: held 3.725s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Flow 'volume_create_manager' (c2fa3ece-38cf-497b-9b41-698be817c1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2401950d-68b8-4088-976d-c607f9902fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2401950d-68b8-4088-976d-c607f9902fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1948519521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0f9974-05d1-474e-bffe-4af417aebf6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee3b9d13f8944c9951ecf27e6dc277a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:08:03Z,use_quota=True,user_id='059aad4358e94a4087b486fa174b4723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0085f7ac-716f-490c-8e07-905d10216a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0085f7ac-716f-490c-8e07-905d10216a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab5545e-ed1c-4b92-97ac-e1442d038307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab5545e-ed1c-4b92-97ac-e1442d038307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea0f9974-05d1-474e-bffe-4af417aebf6a', 'volume_name': 'volume-ea0f9974-05d1-474e-bffe-4af417aebf6a', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326d0695-3277-4824-b5bd-21dac101d5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326d0695-3277-4824-b5bd-21dac101d5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca7432ad-626f-44f7-9013-b2724fcbf207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:02 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Volume ea0f9974-05d1-474e-bffe-4af417aebf6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea0f9974-05d1-474e-bffe-4af417aebf6a', 'volume_size': 1} Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1948519521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0f9974-05d1-474e-bffe-4af417aebf6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee3b9d13f8944c9951ecf27e6dc277a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:08:03Z,use_quota=True,user_id='059aad4358e94a4087b486fa174b4723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Creating volume ea0f9974-05d1-474e-bffe-4af417aebf6a {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:08:02 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:08:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea0f9974-05d1-474e-bffe-4af417aebf6a 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:02 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea0f9974-05d1-474e-bffe-4af417aebf6a 1073741824 Sep 23 15:08:02 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-43d800a9-50ae-4b75-95f8-58ec95e45e6d tempest-SnapshotsActionsTest-1693360100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:08:03 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea0f9974-05d1-474e-bffe-4af417aebf6a 1073741824" returned: 0 in 0.763s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea0f9974-05d1-474e-bffe-4af417aebf6a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:03 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea0f9974-05d1-474e-bffe-4af417aebf6a Sep 23 15:08:03 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:04 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea0f9974-05d1-474e-bffe-4af417aebf6a" returned: 0 in 0.353s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:08:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:08:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-43d800a9-50ae-4b75-95f8-58ec95e45e6d tempest-SnapshotsActionsTest-1693360100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.636s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:08:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca7432ad-626f-44f7-9013-b2724fcbf207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea0f9974-05d1-474e-bffe-4af417aebf6a', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa716c72-4df8-47b6-a274-4f7eb7423656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:04 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Volume volume-ea0f9974-05d1-474e-bffe-4af417aebf6a (ea0f9974-05d1-474e-bffe-4af417aebf6a): created successfully Sep 23 15:08:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa716c72-4df8-47b6-a274-4f7eb7423656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Flow 'volume_create_manager' (c2fa3ece-38cf-497b-9b41-698be817c1e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:08:04 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-91b228d0-b283-4eeb-aa3d-07050e785ee0 tempest-DeleteServersTestJSON-1682014671 None] Created volume successfully. Sep 23 15:08:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-43d800a9-50ae-4b75-95f8-58ec95e45e6d tempest-SnapshotsActionsTest-1693360100 None] Creating offline snapshot c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca of volume 0fd6be29-0444-4b61-a1d9-041c2d58604d {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:08:04 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[728f8c59-b21c-4fbf-84e5-1d3815f40ec6]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:08:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43d800a9-50ae-4b75-95f8-58ec95e45e6d tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:04 devstack sudo[87736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc Sep 23 15:08:04 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:04 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43d800a9-50ae-4b75-95f8-58ec95e45e6d tempest-SnapshotsActionsTest-1693360100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc" returned: 0 in 0.533s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-43d800a9-50ae-4b75-95f8-58ec95e45e6d tempest-SnapshotsActionsTest-1693360100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd6be29-0444-4b61-a1d9-041c2d58604d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:08:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43d800a9-50ae-4b75-95f8-58ec95e45e6d tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:04 devstack sudo[87742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca 1G Sep 23 15:08:04 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:05 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43d800a9-50ae-4b75-95f8-58ec95e45e6d tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca 1G" returned: 0 in 0.835s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43d800a9-50ae-4b75-95f8-58ec95e45e6d tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:05 devstack sudo[87761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca Sep 23 15:08:05 devstack sudo[87761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:06 devstack sudo[87761]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43d800a9-50ae-4b75-95f8-58ec95e45e6d tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca" returned: 0 in 0.661s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:06 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-43d800a9-50ae-4b75-95f8-58ec95e45e6d tempest-SnapshotsActionsTest-1693360100 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca is being set with open permissions: ugo+rw Sep 23 15:08:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43d800a9-50ae-4b75-95f8-58ec95e45e6d tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:06 devstack sudo[87768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca Sep 23 15:08:06 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:07 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43d800a9-50ae-4b75-95f8-58ec95e45e6d tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca" returned: 0 in 0.639s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-43d800a9-50ae-4b75-95f8-58ec95e45e6d tempest-SnapshotsActionsTest-1693360100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:08:07 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-43d800a9-50ae-4b75-95f8-58ec95e45e6d tempest-SnapshotsActionsTest-1693360100 None] Create snapshot completed successfully Sep 23 15:08:08 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] Acquiring lock "cinder-c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:08:08 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:08:08 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] Acquiring lock "cinder-quobyte-0fd6be29-0444-4b61-a1d9-041c2d58604d" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:08:08 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-quobyte-0fd6be29-0444-4b61-a1d9-041c2d58604d" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:08:08 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] Acquiring lock "cinder-quobyte-c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:08:08 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-quobyte-c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:08:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] Deleting offline snapshot c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca of volume 0fd6be29-0444-4b61-a1d9-041c2d58604d {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:08:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] snapshot_file for this snap is: volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:08:08 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[44908dc3-e69b-4fb2-b2f9-353689220431]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:08:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:08 devstack sudo[87812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca Sep 23 15:08:08 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:08 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca" returned: 0 in 0.534s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd6be29-0444-4b61-a1d9-041c2d58604d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:08:08 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f593b3-ca9d-4041-b721-06bd661d271b]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:08:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:09 devstack sudo[87822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc Sep 23 15:08:09 devstack sudo[87822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:09 devstack cinder-volume[86064]: WARNING py.warnings [req-18dac6f7-e178-4d58-9d87-373463883da7 req-d476a83c-8562-4862-b93d-83a2785a1b17 tempest-DeleteServersTestJSON-1682014671 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 23 15:08:09 devstack cinder-volume[86064]: .first() Sep 23 15:08:09 devstack cinder-volume[86064]: Sep 23 15:08:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-18dac6f7-e178-4d58-9d87-373463883da7 req-d476a83c-8562-4862-b93d-83a2785a1b17 tempest-DeleteServersTestJSON-1682014671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:08:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-18dac6f7-e178-4d58-9d87-373463883da7 req-d476a83c-8562-4862-b93d-83a2785a1b17 tempest-DeleteServersTestJSON-1682014671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:08:09 devstack sudo[87822]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc" returned: 0 in 0.604s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:09 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd6be29-0444-4b61-a1d9-041c2d58604d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:08:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-18dac6f7-e178-4d58-9d87-373463883da7 req-d476a83c-8562-4862-b93d-83a2785a1b17 tempest-DeleteServersTestJSON-1682014671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.072s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:08:09 devstack sudo[87836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca Sep 23 15:08:09 devstack sudo[87836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-18dac6f7-e178-4d58-9d87-373463883da7 req-d476a83c-8562-4862-b93d-83a2785a1b17 tempest-DeleteServersTestJSON-1682014671 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-ea0f9974-05d1-474e-bffe-4af417aebf6a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e5a576f-e4de-4dbb-8596-7e9ad27bba62', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:08:09 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-18dac6f7-e178-4d58-9d87-373463883da7 req-d476a83c-8562-4862-b93d-83a2785a1b17 tempest-DeleteServersTestJSON-1682014671 None] attachment_update completed successfully. Sep 23 15:08:10 devstack sudo[87836]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca" returned: 0 in 0.714s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:10 devstack sudo[87845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca Sep 23 15:08:10 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:10 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca" returned: 0 in 0.455s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-quobyte-c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca" released by "_delete_snapshot" :: held 2.531s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:08:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-quobyte-0fd6be29-0444-4b61-a1d9-041c2d58604d" released by "delete_snapshot" :: held 2.583s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:08:10 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] Created reservations ['d2834579-c391-4327-bd04-8ef6099a1ee9', '1b7ac3fe-5f68-42d0-a78d-55bc78722e0b', 'd55fc4a8-4f74-4a61-b04d-c1498ca39741', '100bf41e-a1d6-4777-a864-d0e683584a7e'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:08:10 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] Delete snapshot completed successfully. Sep 23 15:08:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-42a1c91e-165b-4fea-b17e-b994be1ceb06 tempest-SnapshotsActionsTest-629934790 None] Lock "cinder-c8873788-d7c3-4f3a-9ceb-4bc0d20c66ca-delete_snapshot" released by "delete_snapshot" :: held 2.825s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:08:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0bb9b5ff-df9b-4d1c-8f99-5779388488b4 tempest-SnapshotsActionsTest-1693360100 None] Acquiring lock "cinder-1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:08:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0bb9b5ff-df9b-4d1c-8f99-5779388488b4 tempest-SnapshotsActionsTest-1693360100 None] Lock "cinder-1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:08:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0bb9b5ff-df9b-4d1c-8f99-5779388488b4 tempest-SnapshotsActionsTest-1693360100 None] Acquiring lock "cinder-quobyte-0fd6be29-0444-4b61-a1d9-041c2d58604d" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:08:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0bb9b5ff-df9b-4d1c-8f99-5779388488b4 tempest-SnapshotsActionsTest-1693360100 None] Lock "cinder-quobyte-0fd6be29-0444-4b61-a1d9-041c2d58604d" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:08:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0bb9b5ff-df9b-4d1c-8f99-5779388488b4 tempest-SnapshotsActionsTest-1693360100 None] Acquiring lock "cinder-quobyte-1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:08:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0bb9b5ff-df9b-4d1c-8f99-5779388488b4 tempest-SnapshotsActionsTest-1693360100 None] Lock "cinder-quobyte-1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:08:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-0bb9b5ff-df9b-4d1c-8f99-5779388488b4 tempest-SnapshotsActionsTest-1693360100 None] Deleting offline snapshot 1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc of volume 0fd6be29-0444-4b61-a1d9-041c2d58604d {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:08:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-0bb9b5ff-df9b-4d1c-8f99-5779388488b4 tempest-SnapshotsActionsTest-1693360100 None] snapshot_file for this snap is: volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:08:12 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[46196b94-dc2b-4fba-b0e4-863ad569cf3d]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:08:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0bb9b5ff-df9b-4d1c-8f99-5779388488b4 tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:12 devstack sudo[88303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc Sep 23 15:08:12 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:13 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0bb9b5ff-df9b-4d1c-8f99-5779388488b4 tempest-SnapshotsActionsTest-1693360100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc" returned: 0 in 0.473s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-0bb9b5ff-df9b-4d1c-8f99-5779388488b4 tempest-SnapshotsActionsTest-1693360100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd6be29-0444-4b61-a1d9-041c2d58604d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:08:13 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[339ede40-73c5-403e-858a-1fe2c04a8400]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:08:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0bb9b5ff-df9b-4d1c-8f99-5779388488b4 tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:13 devstack sudo[88313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d Sep 23 15:08:13 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:13 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0bb9b5ff-df9b-4d1c-8f99-5779388488b4 tempest-SnapshotsActionsTest-1693360100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d" returned: 0 in 0.449s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0bb9b5ff-df9b-4d1c-8f99-5779388488b4 tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:13 devstack sudo[88320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc Sep 23 15:08:13 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:14 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0bb9b5ff-df9b-4d1c-8f99-5779388488b4 tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc" returned: 0 in 0.541s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0bb9b5ff-df9b-4d1c-8f99-5779388488b4 tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:14 devstack sudo[88326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc Sep 23 15:08:14 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:14 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0bb9b5ff-df9b-4d1c-8f99-5779388488b4 tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d.1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc" returned: 0 in 0.325s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0bb9b5ff-df9b-4d1c-8f99-5779388488b4 tempest-SnapshotsActionsTest-1693360100 None] Lock "cinder-quobyte-1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc" released by "_delete_snapshot" :: held 2.054s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:08:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0bb9b5ff-df9b-4d1c-8f99-5779388488b4 tempest-SnapshotsActionsTest-1693360100 None] Lock "cinder-quobyte-0fd6be29-0444-4b61-a1d9-041c2d58604d" released by "delete_snapshot" :: held 2.130s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:08:14 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-0bb9b5ff-df9b-4d1c-8f99-5779388488b4 tempest-SnapshotsActionsTest-1693360100 None] Created reservations ['32eb1a89-d4b6-4369-b468-2e54efbb0237', 'cc3eb00e-14d6-40ac-ab28-16241c75c613', '5b466aca-a373-4036-a652-3b4f3f87a3eb', 'b4358deb-92b9-4ae1-abd4-360ff2e287b0'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:08:14 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-0bb9b5ff-df9b-4d1c-8f99-5779388488b4 tempest-SnapshotsActionsTest-1693360100 None] Delete snapshot completed successfully. Sep 23 15:08:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0bb9b5ff-df9b-4d1c-8f99-5779388488b4 tempest-SnapshotsActionsTest-1693360100 None] Lock "cinder-1afdd2b4-99a6-478b-ae9e-ec8ea398dfdc-delete_snapshot" released by "delete_snapshot" :: held 2.351s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:08:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a88882d6-b9cd-479d-b632-24598798e556 tempest-SnapshotsActionsTest-1693360100 None] Acquiring lock "cinder-0fd6be29-0444-4b61-a1d9-041c2d58604d-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:08:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a88882d6-b9cd-479d-b632-24598798e556 tempest-SnapshotsActionsTest-1693360100 None] Lock "cinder-0fd6be29-0444-4b61-a1d9-041c2d58604d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:08:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a88882d6-b9cd-479d-b632-24598798e556 tempest-SnapshotsActionsTest-1693360100 None] Acquiring lock "cinder-quobyte-0fd6be29-0444-4b61-a1d9-041c2d58604d" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:08:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a88882d6-b9cd-479d-b632-24598798e556 tempest-SnapshotsActionsTest-1693360100 None] Lock "cinder-quobyte-0fd6be29-0444-4b61-a1d9-041c2d58604d" acquired by "delete_volume" :: waited 0.039s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:08:15 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3ef678-04a1-4016-ba02-d742eb932673]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:08:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a88882d6-b9cd-479d-b632-24598798e556 tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:16 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d Sep 23 15:08:16 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:16 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a88882d6-b9cd-479d-b632-24598798e556 tempest-SnapshotsActionsTest-1693360100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d" returned: 0 in 0.436s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a88882d6-b9cd-479d-b632-24598798e556 tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:16 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d Sep 23 15:08:16 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:16 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a88882d6-b9cd-479d-b632-24598798e556 tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0fd6be29-0444-4b61-a1d9-041c2d58604d" returned: 0 in 0.299s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a88882d6-b9cd-479d-b632-24598798e556 tempest-SnapshotsActionsTest-1693360100 None] Lock "cinder-quobyte-0fd6be29-0444-4b61-a1d9-041c2d58604d" released by "delete_volume" :: held 0.847s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:08:16 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-a88882d6-b9cd-479d-b632-24598798e556 tempest-SnapshotsActionsTest-1693360100 None] Created reservations ['dd244c7d-67d9-4f0c-a042-8f3ce0c25f24', 'e2c01c76-9c02-4dba-a82c-6958570be278', '9d80d9f1-8f5a-41e6-b783-56d7c8264e5c', '74e1122e-d9fa-4eb8-9564-c2f9e3f60aac'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:08:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a88882d6-b9cd-479d-b632-24598798e556 tempest-SnapshotsActionsTest-1693360100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:08:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a88882d6-b9cd-479d-b632-24598798e556 tempest-SnapshotsActionsTest-1693360100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:08:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a88882d6-b9cd-479d-b632-24598798e556 tempest-SnapshotsActionsTest-1693360100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:08:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a88882d6-b9cd-479d-b632-24598798e556 tempest-SnapshotsActionsTest-1693360100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:08:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a88882d6-b9cd-479d-b632-24598798e556 tempest-SnapshotsActionsTest-1693360100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:08:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a88882d6-b9cd-479d-b632-24598798e556 tempest-SnapshotsActionsTest-1693360100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:16 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:08:16 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:17 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a88882d6-b9cd-479d-b632-24598798e556 tempest-SnapshotsActionsTest-1693360100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.371s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:17 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-a88882d6-b9cd-479d-b632-24598798e556 tempest-SnapshotsActionsTest-1693360100 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:08:17 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-a88882d6-b9cd-479d-b632-24598798e556 tempest-SnapshotsActionsTest-1693360100 None] Deleted volume successfully. Sep 23 15:08:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a88882d6-b9cd-479d-b632-24598798e556 tempest-SnapshotsActionsTest-1693360100 None] Lock "cinder-0fd6be29-0444-4b61-a1d9-041c2d58604d-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:08:19 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-6d29d4d4-a44f-4e57-ba50-3e4b5a234961 req-cec9c9a1-efa8-4c35-b772-9f3062ecf5ff tempest-DeleteServersTestJSON-1682014671 None] Terminate volume connection completed successfully. Sep 23 15:08:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-6d29d4d4-a44f-4e57-ba50-3e4b5a234961 req-cec9c9a1-efa8-4c35-b772-9f3062ecf5ff tempest-DeleteServersTestJSON-1682014671 None] Deleting attachment 8e5a576f-e4de-4dbb-8596-7e9ad27bba62. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:08:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e253015a-95d0-433e-a775-5704b50ca9d8 tempest-DeleteServersTestJSON-1682014671 None] Acquiring lock "cinder-ea0f9974-05d1-474e-bffe-4af417aebf6a-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:08:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e253015a-95d0-433e-a775-5704b50ca9d8 tempest-DeleteServersTestJSON-1682014671 None] Lock "cinder-ea0f9974-05d1-474e-bffe-4af417aebf6a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:08:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e253015a-95d0-433e-a775-5704b50ca9d8 tempest-DeleteServersTestJSON-1682014671 None] Acquiring lock "cinder-quobyte-ea0f9974-05d1-474e-bffe-4af417aebf6a" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:08:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e253015a-95d0-433e-a775-5704b50ca9d8 tempest-DeleteServersTestJSON-1682014671 None] Lock "cinder-quobyte-ea0f9974-05d1-474e-bffe-4af417aebf6a" acquired by "delete_volume" :: waited 0.016s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:08:21 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e4e91e-5d20-4641-af6c-f58d7abb350f]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:08:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e253015a-95d0-433e-a775-5704b50ca9d8 tempest-DeleteServersTestJSON-1682014671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea0f9974-05d1-474e-bffe-4af417aebf6a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:21 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea0f9974-05d1-474e-bffe-4af417aebf6a Sep 23 15:08:21 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:22 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e253015a-95d0-433e-a775-5704b50ca9d8 tempest-DeleteServersTestJSON-1682014671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea0f9974-05d1-474e-bffe-4af417aebf6a" returned: 0 in 0.612s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e253015a-95d0-433e-a775-5704b50ca9d8 tempest-DeleteServersTestJSON-1682014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea0f9974-05d1-474e-bffe-4af417aebf6a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:22 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea0f9974-05d1-474e-bffe-4af417aebf6a Sep 23 15:08:22 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:22 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e253015a-95d0-433e-a775-5704b50ca9d8 tempest-DeleteServersTestJSON-1682014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea0f9974-05d1-474e-bffe-4af417aebf6a" returned: 0 in 0.389s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e253015a-95d0-433e-a775-5704b50ca9d8 tempest-DeleteServersTestJSON-1682014671 None] Lock "cinder-quobyte-ea0f9974-05d1-474e-bffe-4af417aebf6a" released by "delete_volume" :: held 1.092s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:08:22 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-e253015a-95d0-433e-a775-5704b50ca9d8 tempest-DeleteServersTestJSON-1682014671 None] Created reservations ['e01cc79c-22bf-440d-ae58-3aa2e0dbe94f', 'a29e84c2-4a48-4830-9c94-fdf5e3182248', '68470bed-e5ad-44a9-9f7b-62045b099a42', 'c2be8fac-98aa-4a4f-9c57-10961603deeb'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:08:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e253015a-95d0-433e-a775-5704b50ca9d8 tempest-DeleteServersTestJSON-1682014671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:08:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e253015a-95d0-433e-a775-5704b50ca9d8 tempest-DeleteServersTestJSON-1682014671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:08:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e253015a-95d0-433e-a775-5704b50ca9d8 tempest-DeleteServersTestJSON-1682014671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:08:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e253015a-95d0-433e-a775-5704b50ca9d8 tempest-DeleteServersTestJSON-1682014671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:08:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e253015a-95d0-433e-a775-5704b50ca9d8 tempest-DeleteServersTestJSON-1682014671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:08:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e253015a-95d0-433e-a775-5704b50ca9d8 tempest-DeleteServersTestJSON-1682014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:22 devstack sudo[88360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:08:22 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:23 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e253015a-95d0-433e-a775-5704b50ca9d8 tempest-DeleteServersTestJSON-1682014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.327s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:23 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-e253015a-95d0-433e-a775-5704b50ca9d8 tempest-DeleteServersTestJSON-1682014671 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:08:23 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-e253015a-95d0-433e-a775-5704b50ca9d8 tempest-DeleteServersTestJSON-1682014671 None] Deleted volume successfully. Sep 23 15:08:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e253015a-95d0-433e-a775-5704b50ca9d8 tempest-DeleteServersTestJSON-1682014671 None] Lock "cinder-ea0f9974-05d1-474e-bffe-4af417aebf6a-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Flow 'volume_create_manager' (cfc19538-3af8-4f82-8fcc-dbb56d0487b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac144b2-4894-4fff-8720-43b4ae1f8c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac144b2-4894-4fff-8720-43b4ae1f8c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2077950668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce56a77b38f442d9d4ae16332dbe8ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:08:29Z,use_quota=True,user_id='3154d18cffb7487b99048c2d4344255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100e00e1-8037-4b10-a75d-b3ff1d9fabaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100e00e1-8037-4b10-a75d-b3ff1d9fabaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49263a99-abf2-4da9-ac12-30ec4955945d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49263a99-abf2-4da9-ac12-30ec4955945d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e', 'volume_name': 'volume-a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bedda4f-951c-45e3-b450-9d644d4b10c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bedda4f-951c-45e3-b450-9d644d4b10c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ce97a2-f500-4ec9-8997-2aaa2cf4af25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:29 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Volume a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e', 'volume_size': 1} Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2077950668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce56a77b38f442d9d4ae16332dbe8ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:08:29Z,use_quota=True,user_id='3154d18cffb7487b99048c2d4344255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Creating volume a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:08:29 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:29 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e 1073741824 Sep 23 15:08:29 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:29 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e 1073741824" returned: 0 in 0.574s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:29 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e Sep 23 15:08:29 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:30 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e" returned: 0 in 0.280s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:08:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:08:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ce97a2-f500-4ec9-8997-2aaa2cf4af25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e321be1-0387-4219-b48d-656456590dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:30 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Volume volume-a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e (a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e): created successfully Sep 23 15:08:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e321be1-0387-4219-b48d-656456590dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Flow 'volume_create_manager' (cfc19538-3af8-4f82-8fcc-dbb56d0487b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:08:30 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-a132ddb8-ab7d-450c-ac08-1fd972a890e4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Created volume successfully. Sep 23 15:08:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cf5fa96c-ff32-4eb6-853a-ca30936c7c77 tempest-VolumeQuotasAdminTestJSON-176899705 None] Acquiring lock "cinder-a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:08:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cf5fa96c-ff32-4eb6-853a-ca30936c7c77 tempest-VolumeQuotasAdminTestJSON-176899705 None] Lock "cinder-a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:08:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cf5fa96c-ff32-4eb6-853a-ca30936c7c77 tempest-VolumeQuotasAdminTestJSON-176899705 None] Acquiring lock "cinder-quobyte-a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:08:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cf5fa96c-ff32-4eb6-853a-ca30936c7c77 tempest-VolumeQuotasAdminTestJSON-176899705 None] Lock "cinder-quobyte-a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e" acquired by "delete_volume" :: waited 0.024s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:08:31 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac193082-f272-4b1b-9f6b-64496eefccfa]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:08:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cf5fa96c-ff32-4eb6-853a-ca30936c7c77 tempest-VolumeQuotasAdminTestJSON-176899705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:31 devstack sudo[88379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e Sep 23 15:08:31 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:32 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cf5fa96c-ff32-4eb6-853a-ca30936c7c77 tempest-VolumeQuotasAdminTestJSON-176899705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e" returned: 0 in 0.542s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cf5fa96c-ff32-4eb6-853a-ca30936c7c77 tempest-VolumeQuotasAdminTestJSON-176899705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:32 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e Sep 23 15:08:32 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:32 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cf5fa96c-ff32-4eb6-853a-ca30936c7c77 tempest-VolumeQuotasAdminTestJSON-176899705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e" returned: 0 in 0.340s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cf5fa96c-ff32-4eb6-853a-ca30936c7c77 tempest-VolumeQuotasAdminTestJSON-176899705 None] Lock "cinder-quobyte-a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e" released by "delete_volume" :: held 0.961s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:08:32 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-cf5fa96c-ff32-4eb6-853a-ca30936c7c77 tempest-VolumeQuotasAdminTestJSON-176899705 None] Created reservations ['ce6a0343-70d1-49fa-b8b0-9b020cd50f6c', '4c9e609b-eb01-4793-a631-7d6f2fe3c59a', '2aa548b9-02ea-40cb-b86a-1f2f8625e193', 'f8b043cf-1613-425c-9983-99153c8876ad'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:08:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cf5fa96c-ff32-4eb6-853a-ca30936c7c77 tempest-VolumeQuotasAdminTestJSON-176899705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:08:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cf5fa96c-ff32-4eb6-853a-ca30936c7c77 tempest-VolumeQuotasAdminTestJSON-176899705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:08:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cf5fa96c-ff32-4eb6-853a-ca30936c7c77 tempest-VolumeQuotasAdminTestJSON-176899705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:08:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cf5fa96c-ff32-4eb6-853a-ca30936c7c77 tempest-VolumeQuotasAdminTestJSON-176899705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:08:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cf5fa96c-ff32-4eb6-853a-ca30936c7c77 tempest-VolumeQuotasAdminTestJSON-176899705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:08:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cf5fa96c-ff32-4eb6-853a-ca30936c7c77 tempest-VolumeQuotasAdminTestJSON-176899705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:32 devstack sudo[88396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:08:32 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:33 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cf5fa96c-ff32-4eb6-853a-ca30936c7c77 tempest-VolumeQuotasAdminTestJSON-176899705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.408s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-cf5fa96c-ff32-4eb6-853a-ca30936c7c77 tempest-VolumeQuotasAdminTestJSON-176899705 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:08:33 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-cf5fa96c-ff32-4eb6-853a-ca30936c7c77 tempest-VolumeQuotasAdminTestJSON-176899705 None] Deleted volume successfully. Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cf5fa96c-ff32-4eb6-853a-ca30936c7c77 tempest-VolumeQuotasAdminTestJSON-176899705 None] Lock "cinder-a77dedd9-b9d2-429c-ad4e-f6dd6bbf072e-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Flow 'volume_create_manager' (ab1fadbb-6709-45dc-a8da-9de8a87f228f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72deb019-6d18-4443-8989-01d06ca58a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72deb019-6d18-4443-8989-01d06ca58a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1472327081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=615482ed-155c-4fed-800a-35483b4eaf1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce56a77b38f442d9d4ae16332dbe8ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:08:34Z,use_quota=True,user_id='3154d18cffb7487b99048c2d4344255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aee0010-65e8-41fe-90b5-9eb3286804b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aee0010-65e8-41fe-90b5-9eb3286804b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f795aeea-b011-40f6-93ec-445233caab9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f795aeea-b011-40f6-93ec-445233caab9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '615482ed-155c-4fed-800a-35483b4eaf1f', 'volume_name': 'volume-615482ed-155c-4fed-800a-35483b4eaf1f', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ef0bfc-36f7-4d37-8d85-9edf076ad72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ef0bfc-36f7-4d37-8d85-9edf076ad72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb5a3c45-5d26-4b66-921d-ba1ace1f9b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:33 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Volume 615482ed-155c-4fed-800a-35483b4eaf1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-615482ed-155c-4fed-800a-35483b4eaf1f', 'volume_size': 1} Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1472327081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=615482ed-155c-4fed-800a-35483b4eaf1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce56a77b38f442d9d4ae16332dbe8ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:08:34Z,use_quota=True,user_id='3154d18cffb7487b99048c2d4344255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Creating volume 615482ed-155c-4fed-800a-35483b4eaf1f {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:08:33 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:08:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-615482ed-155c-4fed-800a-35483b4eaf1f 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:33 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-615482ed-155c-4fed-800a-35483b4eaf1f 1073741824 Sep 23 15:08:33 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:34 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-615482ed-155c-4fed-800a-35483b4eaf1f 1073741824" returned: 0 in 0.653s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-615482ed-155c-4fed-800a-35483b4eaf1f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:34 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-615482ed-155c-4fed-800a-35483b4eaf1f Sep 23 15:08:34 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:34 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-615482ed-155c-4fed-800a-35483b4eaf1f" returned: 0 in 0.386s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:08:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:08:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb5a3c45-5d26-4b66-921d-ba1ace1f9b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-615482ed-155c-4fed-800a-35483b4eaf1f', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8cb0ab5-dc8f-4206-9dc1-afc966b1f40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:34 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Volume volume-615482ed-155c-4fed-800a-35483b4eaf1f (615482ed-155c-4fed-800a-35483b4eaf1f): created successfully Sep 23 15:08:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8cb0ab5-dc8f-4206-9dc1-afc966b1f40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Flow 'volume_create_manager' (ab1fadbb-6709-45dc-a8da-9de8a87f228f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:08:34 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-26b02229-4709-41d9-b5d9-3aed9b4abab4 tempest-VolumeQuotasAdminTestJSON-176899705 None] Created volume successfully. Sep 23 15:08:35 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:08:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Flow 'volume_create_manager' (b9e3a742-bf89-4472-a348-dd59a8f2fc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:08:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346dba36-bbb0-4c50-bb60-be5da415ae2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346dba36-bbb0-4c50-bb60-be5da415ae2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1713086783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f045854-bd88-495e-a839-ed1a57829e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b90cc3317440f5bf76efc85de98224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:08:35Z,use_quota=True,user_id='ed674d9929ba4d28984c608dfb354235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f3aeef5-7d05-4e68-a24b-7c79b86c26d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f3aeef5-7d05-4e68-a24b-7c79b86c26d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8155f9f-4f2b-42bb-9bf6-518cde1e19c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8155f9f-4f2b-42bb-9bf6-518cde1e19c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f045854-bd88-495e-a839-ed1a57829e8b', 'volume_name': 'volume-1f045854-bd88-495e-a839-ed1a57829e8b', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42d8efe-0921-4ce5-bf8d-1883c3c6c9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42d8efe-0921-4ce5-bf8d-1883c3c6c9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f3806a-289d-4459-a8ea-64514fbf1009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:35 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Volume 1f045854-bd88-495e-a839-ed1a57829e8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f045854-bd88-495e-a839-ed1a57829e8b', 'volume_size': 1} Sep 23 15:08:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:08:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:08:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1713086783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f045854-bd88-495e-a839-ed1a57829e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b90cc3317440f5bf76efc85de98224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:08:35Z,use_quota=True,user_id='ed674d9929ba4d28984c608dfb354235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:08:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Creating volume 1f045854-bd88-495e-a839-ed1a57829e8b {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:08:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:08:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:08:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:08:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:08:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:08:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:08:35 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:08:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f045854-bd88-495e-a839-ed1a57829e8b 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:35 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f045854-bd88-495e-a839-ed1a57829e8b 1073741824 Sep 23 15:08:35 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:08:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:08:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:08:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:08:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:08:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:08:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:36 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:08:36 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:36 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f045854-bd88-495e-a839-ed1a57829e8b 1073741824" returned: 0 in 0.717s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f045854-bd88-495e-a839-ed1a57829e8b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:36 devstack sudo[88440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f045854-bd88-495e-a839-ed1a57829e8b Sep 23 15:08:36 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:36 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.383s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:08:36 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f045854-bd88-495e-a839-ed1a57829e8b" returned: 0 in 0.382s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:08:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:08:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f3806a-289d-4459-a8ea-64514fbf1009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f045854-bd88-495e-a839-ed1a57829e8b', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3518e182-805d-4b4b-8da9-3df80aec085c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:36 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Volume volume-1f045854-bd88-495e-a839-ed1a57829e8b (1f045854-bd88-495e-a839-ed1a57829e8b): created successfully Sep 23 15:08:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3518e182-805d-4b4b-8da9-3df80aec085c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Flow 'volume_create_manager' (b9e3a742-bf89-4472-a348-dd59a8f2fc4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:08:36 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-815bd372-3259-42fd-9a2b-c5b633bcafee tempest-TaggedAttachmentsTest-897174467 None] Created volume successfully. Sep 23 15:08:37 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-0ee541e0-f6c8-465e-9826-693d11f23132 tempest-VolumeQuotasAdminTestJSON-1026491524 None] Transfer volume completed successfully. Sep 23 15:08:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5bd367d8-4a48-40c7-8328-0225017b042f tempest-VolumeQuotasAdminTestJSON-804945741 None] Acquiring lock "cinder-615482ed-155c-4fed-800a-35483b4eaf1f-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:08:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5bd367d8-4a48-40c7-8328-0225017b042f tempest-VolumeQuotasAdminTestJSON-804945741 None] Lock "cinder-615482ed-155c-4fed-800a-35483b4eaf1f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:08:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5bd367d8-4a48-40c7-8328-0225017b042f tempest-VolumeQuotasAdminTestJSON-804945741 None] Acquiring lock "cinder-quobyte-615482ed-155c-4fed-800a-35483b4eaf1f" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:08:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5bd367d8-4a48-40c7-8328-0225017b042f tempest-VolumeQuotasAdminTestJSON-804945741 None] Lock "cinder-quobyte-615482ed-155c-4fed-800a-35483b4eaf1f" acquired by "delete_volume" :: waited 0.028s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:08:37 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c806c43b-0a23-4a57-8855-adfe2315fcdc]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:08:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5bd367d8-4a48-40c7-8328-0225017b042f tempest-VolumeQuotasAdminTestJSON-804945741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-615482ed-155c-4fed-800a-35483b4eaf1f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:38 devstack sudo[88445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-615482ed-155c-4fed-800a-35483b4eaf1f Sep 23 15:08:38 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:38 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5bd367d8-4a48-40c7-8328-0225017b042f tempest-VolumeQuotasAdminTestJSON-804945741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-615482ed-155c-4fed-800a-35483b4eaf1f" returned: 0 in 0.476s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5bd367d8-4a48-40c7-8328-0225017b042f tempest-VolumeQuotasAdminTestJSON-804945741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-615482ed-155c-4fed-800a-35483b4eaf1f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:38 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-615482ed-155c-4fed-800a-35483b4eaf1f Sep 23 15:08:38 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:38 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5bd367d8-4a48-40c7-8328-0225017b042f tempest-VolumeQuotasAdminTestJSON-804945741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-615482ed-155c-4fed-800a-35483b4eaf1f" returned: 0 in 0.292s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5bd367d8-4a48-40c7-8328-0225017b042f tempest-VolumeQuotasAdminTestJSON-804945741 None] Lock "cinder-quobyte-615482ed-155c-4fed-800a-35483b4eaf1f" released by "delete_volume" :: held 0.847s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:08:38 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-5bd367d8-4a48-40c7-8328-0225017b042f tempest-VolumeQuotasAdminTestJSON-804945741 None] Created reservations ['7a576680-7851-4e0e-884e-d80051ea7e27', '5adf939a-ad93-4495-8240-9d34a5f074b5', '6db2a250-93d5-4347-a0b3-3c82e339ed17', '86db0bec-b093-4f9e-9917-c98b6b1bc68e'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:08:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5bd367d8-4a48-40c7-8328-0225017b042f tempest-VolumeQuotasAdminTestJSON-804945741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:08:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5bd367d8-4a48-40c7-8328-0225017b042f tempest-VolumeQuotasAdminTestJSON-804945741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:08:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5bd367d8-4a48-40c7-8328-0225017b042f tempest-VolumeQuotasAdminTestJSON-804945741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:08:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5bd367d8-4a48-40c7-8328-0225017b042f tempest-VolumeQuotasAdminTestJSON-804945741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:08:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5bd367d8-4a48-40c7-8328-0225017b042f tempest-VolumeQuotasAdminTestJSON-804945741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:08:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5bd367d8-4a48-40c7-8328-0225017b042f tempest-VolumeQuotasAdminTestJSON-804945741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:38 devstack sudo[88454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:08:38 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:39 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5bd367d8-4a48-40c7-8328-0225017b042f tempest-VolumeQuotasAdminTestJSON-804945741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.290s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:39 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-5bd367d8-4a48-40c7-8328-0225017b042f tempest-VolumeQuotasAdminTestJSON-804945741 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:08:39 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5bd367d8-4a48-40c7-8328-0225017b042f tempest-VolumeQuotasAdminTestJSON-804945741 None] Deleted volume successfully. Sep 23 15:08:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5bd367d8-4a48-40c7-8328-0225017b042f tempest-VolumeQuotasAdminTestJSON-804945741 None] Lock "cinder-615482ed-155c-4fed-800a-35483b4eaf1f-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:08:48 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=53,cinder:INSERT=17,cinder:UPDATE=57,cinder:DELETE=4 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:08:49 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=53,cinder:INSERT=15,cinder:UPDATE=70,cinder:DELETE=5 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:08:52 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:08:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Flow 'volume_create_manager' (5ba8a288-fddf-47ec-a4c8-3547fdc4d8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:08:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14130831-3e16-4905-bf1d-efb8692e5312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14130831-3e16-4905-bf1d-efb8692e5312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1644966638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e7914d9-fdca-463f-9250-cb3fe867c858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71ea2a7a51c44fe890b14dcdda91a7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:08:53Z,use_quota=True,user_id='c1eaf57497ba41b1a35c9bde6431bbbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76dc03ad-137a-4ea5-85b4-be190c48a714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76dc03ad-137a-4ea5-85b4-be190c48a714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a0bb0e-9c49-49e0-b956-222b1d003f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a0bb0e-9c49-49e0-b956-222b1d003f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e7914d9-fdca-463f-9250-cb3fe867c858', 'volume_name': 'volume-0e7914d9-fdca-463f-9250-cb3fe867c858', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d46304-cca6-4aa2-9b7a-1010a6c40a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d46304-cca6-4aa2-9b7a-1010a6c40a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257a4ba5-a498-478e-aa17-6337bf941993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:52 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Volume 0e7914d9-fdca-463f-9250-cb3fe867c858: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e7914d9-fdca-463f-9250-cb3fe867c858', 'volume_size': 1} Sep 23 15:08:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:08:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:08:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1644966638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e7914d9-fdca-463f-9250-cb3fe867c858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71ea2a7a51c44fe890b14dcdda91a7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:08:53Z,use_quota=True,user_id='c1eaf57497ba41b1a35c9bde6431bbbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:08:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Creating volume 0e7914d9-fdca-463f-9250-cb3fe867c858 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:08:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:08:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:08:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:08:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:08:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:08:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:08:52 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:08:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0e7914d9-fdca-463f-9250-cb3fe867c858 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:53 devstack sudo[88552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0e7914d9-fdca-463f-9250-cb3fe867c858 1073741824 Sep 23 15:08:53 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:53 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0e7914d9-fdca-463f-9250-cb3fe867c858 1073741824" returned: 0 in 0.674s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0e7914d9-fdca-463f-9250-cb3fe867c858 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:53 devstack sudo[88558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0e7914d9-fdca-463f-9250-cb3fe867c858 Sep 23 15:08:53 devstack sudo[88558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:54 devstack sudo[88558]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0e7914d9-fdca-463f-9250-cb3fe867c858" returned: 0 in 0.581s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:08:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:08:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257a4ba5-a498-478e-aa17-6337bf941993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e7914d9-fdca-463f-9250-cb3fe867c858', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4079856c-8f8a-423e-a595-84e75c946676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:08:54 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Volume volume-0e7914d9-fdca-463f-9250-cb3fe867c858 (0e7914d9-fdca-463f-9250-cb3fe867c858): created successfully Sep 23 15:08:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4079856c-8f8a-423e-a595-84e75c946676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:08:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Flow 'volume_create_manager' (5ba8a288-fddf-47ec-a4c8-3547fdc4d8bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:08:54 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-a4207942-802d-4e47-a7a9-041a14725e85 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Created volume successfully. Sep 23 15:08:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-43536b49-4401-42f5-8c9d-f985b762c8e5 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Acquiring lock "cinder-0e7914d9-fdca-463f-9250-cb3fe867c858-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:08:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-43536b49-4401-42f5-8c9d-f985b762c8e5 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Lock "cinder-0e7914d9-fdca-463f-9250-cb3fe867c858-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:08:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-43536b49-4401-42f5-8c9d-f985b762c8e5 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Acquiring lock "cinder-quobyte-0e7914d9-fdca-463f-9250-cb3fe867c858" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:08:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-43536b49-4401-42f5-8c9d-f985b762c8e5 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Lock "cinder-quobyte-0e7914d9-fdca-463f-9250-cb3fe867c858" acquired by "delete_volume" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:08:56 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9189bb26-bc07-4dda-804e-63880a3627e1]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:08:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43536b49-4401-42f5-8c9d-f985b762c8e5 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0e7914d9-fdca-463f-9250-cb3fe867c858 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:56 devstack sudo[88587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0e7914d9-fdca-463f-9250-cb3fe867c858 Sep 23 15:08:56 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:56 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43536b49-4401-42f5-8c9d-f985b762c8e5 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0e7914d9-fdca-463f-9250-cb3fe867c858" returned: 0 in 0.615s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43536b49-4401-42f5-8c9d-f985b762c8e5 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0e7914d9-fdca-463f-9250-cb3fe867c858 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:56 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0e7914d9-fdca-463f-9250-cb3fe867c858 Sep 23 15:08:56 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:57 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43536b49-4401-42f5-8c9d-f985b762c8e5 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0e7914d9-fdca-463f-9250-cb3fe867c858" returned: 0 in 0.569s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:57 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-43536b49-4401-42f5-8c9d-f985b762c8e5 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Lock "cinder-quobyte-0e7914d9-fdca-463f-9250-cb3fe867c858" released by "delete_volume" :: held 1.257s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:08:57 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-43536b49-4401-42f5-8c9d-f985b762c8e5 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Created reservations ['af3ea1b4-507a-4e57-b003-76c991824a20', '89717056-d97c-4f73-bfa6-7ca1aef925bd', 'f7b6952f-af17-4a8c-a09a-b6438966afb2', 'c5406649-a782-49fc-b337-1cbf303a5a5a'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:08:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-43536b49-4401-42f5-8c9d-f985b762c8e5 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:08:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-43536b49-4401-42f5-8c9d-f985b762c8e5 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:08:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-43536b49-4401-42f5-8c9d-f985b762c8e5 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:08:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-43536b49-4401-42f5-8c9d-f985b762c8e5 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:08:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-43536b49-4401-42f5-8c9d-f985b762c8e5 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:08:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43536b49-4401-42f5-8c9d-f985b762c8e5 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:08:57 devstack sudo[88663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:08:57 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:08:58 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root Sep 23 15:08:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43536b49-4401-42f5-8c9d-f985b762c8e5 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.323s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:08:58 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-43536b49-4401-42f5-8c9d-f985b762c8e5 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:08:58 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-43536b49-4401-42f5-8c9d-f985b762c8e5 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Deleted volume successfully. Sep 23 15:08:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-43536b49-4401-42f5-8c9d-f985b762c8e5 tempest-VolumeQuotasNegativeTestJSON-1539344478 None] Lock "cinder-0e7914d9-fdca-463f-9250-cb3fe867c858-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:09:07 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=8,cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:09:08 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Flow 'volume_create_manager' (f23c67d0-7df1-4faa-9bea-e2d7567cda4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7336d57c-5d1d-4bd6-81c9-bf74149ad28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7336d57c-5d1d-4bd6-81c9-bf74149ad28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-10013672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cead510-c185-48d2-82ad-2b35a175547d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='036ac29b2a694cd3ae4fc141762ddaf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:09:11Z,use_quota=True,user_id='196a579d2dfa42ac93b8268d8eda3b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74ab1d1b-ef2c-40ea-aabd-8e21cfbad7e3),volume_type_id=74ab1d1b-ef2c-40ea-aabd-8e21cfbad7e3)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02eaa624-9454-4a89-ab4d-6ca8d1e03fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02eaa624-9454-4a89-ab4d-6ca8d1e03fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b915a94-f8a6-4d4e-bfbd-ce866ca59111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b915a94-f8a6-4d4e-bfbd-ce866ca59111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cead510-c185-48d2-82ad-2b35a175547d', 'volume_name': 'volume-2cead510-c185-48d2-82ad-2b35a175547d', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4519e1-36bb-4d3b-8409-42175ef411d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4519e1-36bb-4d3b-8409-42175ef411d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0fa6d9-02bd-421f-b80b-462c0cc71932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:09:11 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Volume 2cead510-c185-48d2-82ad-2b35a175547d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cead510-c185-48d2-82ad-2b35a175547d', 'volume_size': 1} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-10013672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cead510-c185-48d2-82ad-2b35a175547d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='036ac29b2a694cd3ae4fc141762ddaf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:09:11Z,use_quota=True,user_id='196a579d2dfa42ac93b8268d8eda3b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74ab1d1b-ef2c-40ea-aabd-8e21cfbad7e3),volume_type_id=74ab1d1b-ef2c-40ea-aabd-8e21cfbad7e3)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Creating volume 2cead510-c185-48d2-82ad-2b35a175547d {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:09:11 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2cead510-c185-48d2-82ad-2b35a175547d 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:09:11 devstack sudo[88844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2cead510-c185-48d2-82ad-2b35a175547d 1073741824 Sep 23 15:09:11 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Flow 'volume_create_manager' (9e290c8a-5f49-4410-821e-8460f33b2750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2bf71d9-b690-4b24-ae66-b2543c6476b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2bf71d9-b690-4b24-ae66-b2543c6476b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-749364509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c8405d0-74ea-411c-9e0c-a2e3707bafef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f34b7110daa042c78f84281da7b22323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:09:12Z,use_quota=True,user_id='3690243cf76a438db6e500e0b4e7b8e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3d7b73-b178-44a3-8274-5d06f41bd5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3d7b73-b178-44a3-8274-5d06f41bd5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb36c029-a446-4eab-8bdb-c223626513cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb36c029-a446-4eab-8bdb-c223626513cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c8405d0-74ea-411c-9e0c-a2e3707bafef', 'volume_name': 'volume-2c8405d0-74ea-411c-9e0c-a2e3707bafef', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ec6555-309f-4bf2-8d22-45b9e24321c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ec6555-309f-4bf2-8d22-45b9e24321c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (303be29d-6de7-4671-a85f-dfdfbc6810df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:09:11 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Volume 2c8405d0-74ea-411c-9e0c-a2e3707bafef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c8405d0-74ea-411c-9e0c-a2e3707bafef', 'volume_size': 1} Sep 23 15:09:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:09:12 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root Sep 23 15:09:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2cead510-c185-48d2-82ad-2b35a175547d 1073741824" returned: 0 in 0.576s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:09:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2cead510-c185-48d2-82ad-2b35a175547d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:09:12 devstack sudo[88851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2cead510-c185-48d2-82ad-2b35a175547d Sep 23 15:09:12 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:09:12 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root Sep 23 15:09:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2cead510-c185-48d2-82ad-2b35a175547d" returned: 0 in 0.266s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:09:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:09:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:09:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.502s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:09:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-749364509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c8405d0-74ea-411c-9e0c-a2e3707bafef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f34b7110daa042c78f84281da7b22323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:09:12Z,use_quota=True,user_id='3690243cf76a438db6e500e0b4e7b8e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:09:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Creating volume 2c8405d0-74ea-411c-9e0c-a2e3707bafef {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:09:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:09:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:09:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:09:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:09:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:09:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:09:12 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:09:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2c8405d0-74ea-411c-9e0c-a2e3707bafef 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:09:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0fa6d9-02bd-421f-b80b-462c0cc71932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cead510-c185-48d2-82ad-2b35a175547d', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:09:12 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2c8405d0-74ea-411c-9e0c-a2e3707bafef 1073741824 Sep 23 15:09:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42456627-1879-472c-b329-60b3899fd4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:09:12 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:09:12 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Volume volume-2cead510-c185-48d2-82ad-2b35a175547d (2cead510-c185-48d2-82ad-2b35a175547d): created successfully Sep 23 15:09:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42456627-1879-472c-b329-60b3899fd4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:09:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Flow 'volume_create_manager' (f23c67d0-7df1-4faa-9bea-e2d7567cda4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:09:12 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5a694512-cdc2-4946-983e-db629119e871 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Created volume successfully. Sep 23 15:09:13 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Sep 23 15:09:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2c8405d0-74ea-411c-9e0c-a2e3707bafef 1073741824" returned: 0 in 0.542s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:09:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2c8405d0-74ea-411c-9e0c-a2e3707bafef {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:09:13 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2c8405d0-74ea-411c-9e0c-a2e3707bafef Sep 23 15:09:13 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:09:13 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Sep 23 15:09:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2c8405d0-74ea-411c-9e0c-a2e3707bafef" returned: 0 in 0.262s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:09:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:09:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:09:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (303be29d-6de7-4671-a85f-dfdfbc6810df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c8405d0-74ea-411c-9e0c-a2e3707bafef', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:09:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56bdf364-4a77-40bb-9927-17becf99f909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:09:13 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Volume volume-2c8405d0-74ea-411c-9e0c-a2e3707bafef (2c8405d0-74ea-411c-9e0c-a2e3707bafef): created successfully Sep 23 15:09:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56bdf364-4a77-40bb-9927-17becf99f909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:09:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Flow 'volume_create_manager' (9e290c8a-5f49-4410-821e-8460f33b2750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:09:13 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-585c5ad4-dc23-4fdf-a0f0-e0fbdbaab1a0 tempest-AttachVolumeNegativeTest-588753607 None] Created volume successfully. Sep 23 15:09:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d16be284-3dcd-46aa-be1f-cab4ec3055f5 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:09:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d16be284-3dcd-46aa-be1f-cab4ec3055f5 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:09:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d16be284-3dcd-46aa-be1f-cab4ec3055f5 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:09:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d16be284-3dcd-46aa-be1f-cab4ec3055f5 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:09:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d16be284-3dcd-46aa-be1f-cab4ec3055f5 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:09:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d16be284-3dcd-46aa-be1f-cab4ec3055f5 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:09:14 devstack sudo[88887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:09:14 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:09:14 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root Sep 23 15:09:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d16be284-3dcd-46aa-be1f-cab4ec3055f5 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.280s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:09:14 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-d16be284-3dcd-46aa-be1f-cab4ec3055f5 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:09:14 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-d16be284-3dcd-46aa-be1f-cab4ec3055f5 tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Retype volume completed successfully. Sep 23 15:09:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-e7ce40b6-7c88-4a9e-bf82-ec10580ec202 req-5c8304da-8043-4ddd-a902-9408222345aa tempest-AttachVolumeNegativeTest-588753607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:09:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-e7ce40b6-7c88-4a9e-bf82-ec10580ec202 req-5c8304da-8043-4ddd-a902-9408222345aa tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:09:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-e7ce40b6-7c88-4a9e-bf82-ec10580ec202 req-5c8304da-8043-4ddd-a902-9408222345aa tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:09:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-e7ce40b6-7c88-4a9e-bf82-ec10580ec202 req-5c8304da-8043-4ddd-a902-9408222345aa tempest-AttachVolumeNegativeTest-588753607 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-2c8405d0-74ea-411c-9e0c-a2e3707bafef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46ecedbd-dc66-4d94-bec0-93687b35eaf3', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:09:14 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-e7ce40b6-7c88-4a9e-bf82-ec10580ec202 req-5c8304da-8043-4ddd-a902-9408222345aa tempest-AttachVolumeNegativeTest-588753607 None] attachment_update completed successfully. Sep 23 15:09:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-731cd852-6889-4d93-ace1-840fe32efb1c tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Acquiring lock "cinder-2cead510-c185-48d2-82ad-2b35a175547d-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:09:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-731cd852-6889-4d93-ace1-840fe32efb1c tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Lock "cinder-2cead510-c185-48d2-82ad-2b35a175547d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:09:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-731cd852-6889-4d93-ace1-840fe32efb1c tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Acquiring lock "cinder-quobyte-2cead510-c185-48d2-82ad-2b35a175547d" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:09:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-731cd852-6889-4d93-ace1-840fe32efb1c tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Lock "cinder-quobyte-2cead510-c185-48d2-82ad-2b35a175547d" acquired by "delete_volume" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:09:15 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda0ae98-e6d2-4f33-807d-ad9315d7800d]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:09:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-731cd852-6889-4d93-ace1-840fe32efb1c tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2cead510-c185-48d2-82ad-2b35a175547d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:09:15 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2cead510-c185-48d2-82ad-2b35a175547d Sep 23 15:09:15 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:09:15 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Sep 23 15:09:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-731cd852-6889-4d93-ace1-840fe32efb1c tempest-VolumeRetypeWithoutMigrationTest-557540372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2cead510-c185-48d2-82ad-2b35a175547d" returned: 0 in 0.376s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:09:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-731cd852-6889-4d93-ace1-840fe32efb1c tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2cead510-c185-48d2-82ad-2b35a175547d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:09:15 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2cead510-c185-48d2-82ad-2b35a175547d Sep 23 15:09:15 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:09:16 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Sep 23 15:09:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-731cd852-6889-4d93-ace1-840fe32efb1c tempest-VolumeRetypeWithoutMigrationTest-557540372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2cead510-c185-48d2-82ad-2b35a175547d" returned: 0 in 0.252s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:09:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-731cd852-6889-4d93-ace1-840fe32efb1c tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Lock "cinder-quobyte-2cead510-c185-48d2-82ad-2b35a175547d" released by "delete_volume" :: held 0.679s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:09:16 devstack cinder-volume[86064]: WARNING cinder.quota [None req-731cd852-6889-4d93-ace1-840fe32efb1c tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:09:16 devstack cinder-volume[86064]: WARNING cinder.quota [None req-731cd852-6889-4d93-ace1-840fe32efb1c tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:09:16 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-731cd852-6889-4d93-ace1-840fe32efb1c tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Created reservations ['55eb4863-afa6-4e0f-bc2d-50e015d24379', 'da9ff302-d438-443a-b1b1-825cdbc6b09c', '67fb02e8-77c4-452a-9aeb-135fe8de477f', '4f09b762-85f4-40af-b031-b53556ddbbaf'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:09:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-731cd852-6889-4d93-ace1-840fe32efb1c tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:09:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-731cd852-6889-4d93-ace1-840fe32efb1c tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:09:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-731cd852-6889-4d93-ace1-840fe32efb1c tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:09:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-731cd852-6889-4d93-ace1-840fe32efb1c tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:09:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-731cd852-6889-4d93-ace1-840fe32efb1c tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:09:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-731cd852-6889-4d93-ace1-840fe32efb1c tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:09:16 devstack sudo[89320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:09:16 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:09:16 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root Sep 23 15:09:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-731cd852-6889-4d93-ace1-840fe32efb1c tempest-VolumeRetypeWithoutMigrationTest-557540372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.321s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:09:16 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-731cd852-6889-4d93-ace1-840fe32efb1c tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:09:16 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-731cd852-6889-4d93-ace1-840fe32efb1c tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Deleted volume successfully. Sep 23 15:09:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-731cd852-6889-4d93-ace1-840fe32efb1c tempest-VolumeRetypeWithoutMigrationTest-557540372 None] Lock "cinder-2cead510-c185-48d2-82ad-2b35a175547d-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:09:26 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=21,cinder:INSERT=4,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:09:26 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=24,cinder:UPDATE=20,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:09:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-13096bb2-3999-482c-88d1-9a340c18e977 req-05cc40fb-c74e-48cc-b0c2-320754cbf645 tempest-TaggedAttachmentsTest-897174467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:09:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-13096bb2-3999-482c-88d1-9a340c18e977 req-05cc40fb-c74e-48cc-b0c2-320754cbf645 tempest-TaggedAttachmentsTest-897174467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:09:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-13096bb2-3999-482c-88d1-9a340c18e977 req-05cc40fb-c74e-48cc-b0c2-320754cbf645 tempest-TaggedAttachmentsTest-897174467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:09:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-13096bb2-3999-482c-88d1-9a340c18e977 req-05cc40fb-c74e-48cc-b0c2-320754cbf645 tempest-TaggedAttachmentsTest-897174467 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-1f045854-bd88-495e-a839-ed1a57829e8b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '117dcf83-cbf6-49e7-8260-68d5051732e5', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:09:31 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-13096bb2-3999-482c-88d1-9a340c18e977 req-05cc40fb-c74e-48cc-b0c2-320754cbf645 tempest-TaggedAttachmentsTest-897174467 None] attachment_update completed successfully. Sep 23 15:09:35 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-9bddf653-0f60-43c5-8ca5-f67ea85580b6 req-226e7092-7d8c-44f5-82a6-390a0de1ef39 tempest-TaggedAttachmentsTest-897174467 None] Terminate volume connection completed successfully. Sep 23 15:09:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-9bddf653-0f60-43c5-8ca5-f67ea85580b6 req-226e7092-7d8c-44f5-82a6-390a0de1ef39 tempest-TaggedAttachmentsTest-897174467 None] Deleting attachment 117dcf83-cbf6-49e7-8260-68d5051732e5. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:09:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:09:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:09:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:09:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:09:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:09:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:09:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:09:36 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:09:36 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:09:36 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Sep 23 15:09:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.555s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:09:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:09:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:09:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 8 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:09:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:09:41 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:09:45 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:09:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bc477070-e840-4dd1-8ae7-662359c77ee8 tempest-TaggedAttachmentsTest-897174467 None] Acquiring lock "cinder-1f045854-bd88-495e-a839-ed1a57829e8b-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:09:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bc477070-e840-4dd1-8ae7-662359c77ee8 tempest-TaggedAttachmentsTest-897174467 None] Lock "cinder-1f045854-bd88-495e-a839-ed1a57829e8b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:09:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bc477070-e840-4dd1-8ae7-662359c77ee8 tempest-TaggedAttachmentsTest-897174467 None] Acquiring lock "cinder-quobyte-1f045854-bd88-495e-a839-ed1a57829e8b" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:09:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bc477070-e840-4dd1-8ae7-662359c77ee8 tempest-TaggedAttachmentsTest-897174467 None] Lock "cinder-quobyte-1f045854-bd88-495e-a839-ed1a57829e8b" acquired by "delete_volume" :: waited 0.029s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:09:45 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[776096e9-da7b-40dd-af66-babfa3cb90f8]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:09:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc477070-e840-4dd1-8ae7-662359c77ee8 tempest-TaggedAttachmentsTest-897174467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f045854-bd88-495e-a839-ed1a57829e8b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:09:46 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f045854-bd88-495e-a839-ed1a57829e8b Sep 23 15:09:46 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:09:46 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Sep 23 15:09:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc477070-e840-4dd1-8ae7-662359c77ee8 tempest-TaggedAttachmentsTest-897174467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f045854-bd88-495e-a839-ed1a57829e8b" returned: 0 in 0.599s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:09:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc477070-e840-4dd1-8ae7-662359c77ee8 tempest-TaggedAttachmentsTest-897174467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f045854-bd88-495e-a839-ed1a57829e8b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:09:46 devstack sudo[89613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f045854-bd88-495e-a839-ed1a57829e8b Sep 23 15:09:46 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:09:47 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root Sep 23 15:09:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc477070-e840-4dd1-8ae7-662359c77ee8 tempest-TaggedAttachmentsTest-897174467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f045854-bd88-495e-a839-ed1a57829e8b" returned: 0 in 0.466s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:09:47 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bc477070-e840-4dd1-8ae7-662359c77ee8 tempest-TaggedAttachmentsTest-897174467 None] Lock "cinder-quobyte-1f045854-bd88-495e-a839-ed1a57829e8b" released by "delete_volume" :: held 1.147s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:09:47 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-bc477070-e840-4dd1-8ae7-662359c77ee8 tempest-TaggedAttachmentsTest-897174467 None] Created reservations ['0d07661d-d359-46c9-9b76-9935e7396ba4', '9e9ae54e-29d6-4580-864e-3a7e1f9ddb88', 'bfbceb9a-0548-4ae6-8fff-c129fdad9d93', 'fb4b5b53-4ca8-4510-8386-753a2675b348'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:09:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bc477070-e840-4dd1-8ae7-662359c77ee8 tempest-TaggedAttachmentsTest-897174467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:09:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bc477070-e840-4dd1-8ae7-662359c77ee8 tempest-TaggedAttachmentsTest-897174467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:09:47 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bc477070-e840-4dd1-8ae7-662359c77ee8 tempest-TaggedAttachmentsTest-897174467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:09:47 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bc477070-e840-4dd1-8ae7-662359c77ee8 tempest-TaggedAttachmentsTest-897174467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:09:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bc477070-e840-4dd1-8ae7-662359c77ee8 tempest-TaggedAttachmentsTest-897174467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:09:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc477070-e840-4dd1-8ae7-662359c77ee8 tempest-TaggedAttachmentsTest-897174467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:09:47 devstack sudo[89616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:09:47 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:09:47 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root Sep 23 15:09:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc477070-e840-4dd1-8ae7-662359c77ee8 tempest-TaggedAttachmentsTest-897174467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.555s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:09:47 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-bc477070-e840-4dd1-8ae7-662359c77ee8 tempest-TaggedAttachmentsTest-897174467 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:09:47 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-bc477070-e840-4dd1-8ae7-662359c77ee8 tempest-TaggedAttachmentsTest-897174467 None] Deleted volume successfully. Sep 23 15:09:47 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bc477070-e840-4dd1-8ae7-662359c77ee8 tempest-TaggedAttachmentsTest-897174467 None] Lock "cinder-1f045854-bd88-495e-a839-ed1a57829e8b-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:09:47 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:09:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Flow 'volume_create_manager' (ee309770-813f-43c6-8e1c-20cb96f3dcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:09:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b181dcae-651f-4917-aba0-3e5d7bcc26f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:09:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b181dcae-651f-4917-aba0-3e5d7bcc26f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2031858571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb778eb5-ab01-4cc7-9290-9db864c337ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c406eeae31614e47aea5d660c8829efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:09:48Z,use_quota=True,user_id='0215d47d47a8458195470e86cade3124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:09:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd53a940-211a-4880-bbdc-6e795b587bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:09:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd53a940-211a-4880-bbdc-6e795b587bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:09:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b800070-bc17-444a-8f7d-73266023a735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:09:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b800070-bc17-444a-8f7d-73266023a735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb778eb5-ab01-4cc7-9290-9db864c337ed', 'volume_name': 'volume-fb778eb5-ab01-4cc7-9290-9db864c337ed', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:09:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ccafc1-4700-4f15-8162-2e5f9b713f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:09:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ccafc1-4700-4f15-8162-2e5f9b713f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:09:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12da0850-8700-4d9c-a9db-9c90e08db288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:09:48 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Volume fb778eb5-ab01-4cc7-9290-9db864c337ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb778eb5-ab01-4cc7-9290-9db864c337ed', 'volume_size': 1} Sep 23 15:09:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:09:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:09:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2031858571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb778eb5-ab01-4cc7-9290-9db864c337ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c406eeae31614e47aea5d660c8829efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:09:48Z,use_quota=True,user_id='0215d47d47a8458195470e86cade3124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:09:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Creating volume fb778eb5-ab01-4cc7-9290-9db864c337ed {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:09:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:09:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:09:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:09:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:09:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:09:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:09:48 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:09:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb778eb5-ab01-4cc7-9290-9db864c337ed 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:09:48 devstack sudo[89619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb778eb5-ab01-4cc7-9290-9db864c337ed 1073741824 Sep 23 15:09:48 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:09:48 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root Sep 23 15:09:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb778eb5-ab01-4cc7-9290-9db864c337ed 1073741824" returned: 0 in 0.618s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:09:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb778eb5-ab01-4cc7-9290-9db864c337ed {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:09:48 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb778eb5-ab01-4cc7-9290-9db864c337ed Sep 23 15:09:48 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:09:49 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Sep 23 15:09:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb778eb5-ab01-4cc7-9290-9db864c337ed" returned: 0 in 0.333s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:09:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:09:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:09:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12da0850-8700-4d9c-a9db-9c90e08db288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb778eb5-ab01-4cc7-9290-9db864c337ed', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:09:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c214c6a0-9fb3-4340-9768-83800b987c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:09:49 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Volume volume-fb778eb5-ab01-4cc7-9290-9db864c337ed (fb778eb5-ab01-4cc7-9290-9db864c337ed): created successfully Sep 23 15:09:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c214c6a0-9fb3-4340-9768-83800b987c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:09:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Flow 'volume_create_manager' (ee309770-813f-43c6-8e1c-20cb96f3dcf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:09:49 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-da71176d-a73c-41b6-9d36-079ecd7c8ebf tempest-ServerActionsTestOtherA-977966886 None] Created volume successfully. Sep 23 15:09:59 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:09:59 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=6,cinder:UPDATE=16,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:10:03 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-93b3c043-95a1-454a-9a6c-c47858b590ed req-a37d45f4-4862-465a-a7b1-8d1c51e06f2a tempest-AttachVolumeNegativeTest-588753607 None] Terminate volume connection completed successfully. Sep 23 15:10:03 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-93b3c043-95a1-454a-9a6c-c47858b590ed req-a37d45f4-4862-465a-a7b1-8d1c51e06f2a tempest-AttachVolumeNegativeTest-588753607 None] Deleting attachment 46ecedbd-dc66-4d94-bec0-93687b35eaf3. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:10:13 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=1 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:10:18 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:10:21 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:10:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Flow 'volume_create_manager' (84079c8f-748b-4c13-8796-2adc8896b8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:10:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64336fdb-3d90-4a88-8596-471f8ae67302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64336fdb-3d90-4a88-8596-471f8ae67302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2060458421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ddc72f7-a346-4441-bc5d-366e8eabcdad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84f3e54a41447f69a3cfa161a980c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:10:21Z,use_quota=True,user_id='6bdf04139f884ab198ad90dd81c0f982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f00d6c4-f5ec-4bae-86fb-430ab4c21672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f00d6c4-f5ec-4bae-86fb-430ab4c21672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af4803b4-4721-4c58-9831-1b03918b7ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af4803b4-4721-4c58-9831-1b03918b7ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ddc72f7-a346-4441-bc5d-366e8eabcdad', 'volume_name': 'volume-2ddc72f7-a346-4441-bc5d-366e8eabcdad', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc9fa49-933e-4ab8-864b-4838226c7623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc9fa49-933e-4ab8-864b-4838226c7623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973d41a5-641a-45f4-979d-85ebcfed2a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:21 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Volume 2ddc72f7-a346-4441-bc5d-366e8eabcdad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ddc72f7-a346-4441-bc5d-366e8eabcdad', 'volume_size': 1} Sep 23 15:10:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2060458421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ddc72f7-a346-4441-bc5d-366e8eabcdad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84f3e54a41447f69a3cfa161a980c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:10:21Z,use_quota=True,user_id='6bdf04139f884ab198ad90dd81c0f982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:10:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Creating volume 2ddc72f7-a346-4441-bc5d-366e8eabcdad {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:10:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:10:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:10:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:10:21 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:10:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ddc72f7-a346-4441-bc5d-366e8eabcdad 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:21 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ddc72f7-a346-4441-bc5d-366e8eabcdad 1073741824 Sep 23 15:10:21 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:22 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ddc72f7-a346-4441-bc5d-366e8eabcdad 1073741824" returned: 0 in 0.921s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ddc72f7-a346-4441-bc5d-366e8eabcdad {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:22 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ddc72f7-a346-4441-bc5d-366e8eabcdad Sep 23 15:10:22 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:22 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ddc72f7-a346-4441-bc5d-366e8eabcdad" returned: 0 in 0.663s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:10:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973d41a5-641a-45f4-979d-85ebcfed2a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ddc72f7-a346-4441-bc5d-366e8eabcdad', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3829df20-b67f-41a6-949d-91c28cc6556f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:23 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Volume volume-2ddc72f7-a346-4441-bc5d-366e8eabcdad (2ddc72f7-a346-4441-bc5d-366e8eabcdad): created successfully Sep 23 15:10:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3829df20-b67f-41a6-949d-91c28cc6556f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Flow 'volume_create_manager' (84079c8f-748b-4c13-8796-2adc8896b8dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:10:23 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-644920a8-b159-453b-8928-d999490361cb tempest-VolumesActionsTest-628680531 None] Created volume successfully. Sep 23 15:10:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-635a27ea-da90-491d-804b-9752c2309216 tempest-VolumesActionsTest-628680531 None] Acquiring lock "cinder-2ddc72f7-a346-4441-bc5d-366e8eabcdad" by "attach_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:10:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-635a27ea-da90-491d-804b-9752c2309216 tempest-VolumesActionsTest-628680531 None] Lock "cinder-2ddc72f7-a346-4441-bc5d-366e8eabcdad" acquired by "attach_volume" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:10:24 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-635a27ea-da90-491d-804b-9752c2309216 tempest-VolumesActionsTest-628680531 None] Attaching volume 2ddc72f7-a346-4441-bc5d-366e8eabcdad to instance 23055af0-f975-4903-9d98-739cbd966a43 at mountpoint /dev/vdb on host None. Sep 23 15:10:24 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-635a27ea-da90-491d-804b-9752c2309216 tempest-VolumesActionsTest-628680531 None] Attach volume completed successfully. Sep 23 15:10:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-635a27ea-da90-491d-804b-9752c2309216 tempest-VolumesActionsTest-628680531 None] Lock "cinder-2ddc72f7-a346-4441-bc5d-366e8eabcdad" released by "attach_volume" :: held 0.293s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:10:25 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-3f8dab2f-8151-4784-84b2-19e7adb6493e tempest-VolumesActionsTest-1060395896 None] Terminate volume connection completed successfully. Sep 23 15:10:26 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3f8dab2f-8151-4784-84b2-19e7adb6493e tempest-VolumesActionsTest-1060395896 None] Acquiring lock "cinder-2ddc72f7-a346-4441-bc5d-366e8eabcdad-detach_volume" by "detach_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:10:26 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3f8dab2f-8151-4784-84b2-19e7adb6493e tempest-VolumesActionsTest-1060395896 None] Lock "cinder-2ddc72f7-a346-4441-bc5d-366e8eabcdad-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:10:26 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-3f8dab2f-8151-4784-84b2-19e7adb6493e tempest-VolumesActionsTest-1060395896 None] Detaching volume 2ddc72f7-a346-4441-bc5d-366e8eabcdad from instance 23055af0-f975-4903-9d98-739cbd966a43. Sep 23 15:10:26 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-3f8dab2f-8151-4784-84b2-19e7adb6493e tempest-VolumesActionsTest-1060395896 None] Detach volume completed successfully. Sep 23 15:10:26 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3f8dab2f-8151-4784-84b2-19e7adb6493e tempest-VolumesActionsTest-1060395896 None] Lock "cinder-2ddc72f7-a346-4441-bc5d-366e8eabcdad-detach_volume" released by "detach_volume" :: held 0.143s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:10:26 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c6afd888-5737-4a0b-abb5-a011b6507a32 tempest-VolumesActionsTest-628680531 None] Acquiring lock "cinder-2ddc72f7-a346-4441-bc5d-366e8eabcdad-detach_volume" by "detach_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:10:26 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c6afd888-5737-4a0b-abb5-a011b6507a32 tempest-VolumesActionsTest-628680531 None] Lock "cinder-2ddc72f7-a346-4441-bc5d-366e8eabcdad-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:10:26 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-c6afd888-5737-4a0b-abb5-a011b6507a32 tempest-VolumesActionsTest-628680531 None] Volume detach called, but volume not attached. Sep 23 15:10:26 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c6afd888-5737-4a0b-abb5-a011b6507a32 tempest-VolumesActionsTest-628680531 None] Lock "cinder-2ddc72f7-a346-4441-bc5d-366e8eabcdad-detach_volume" released by "detach_volume" :: held 0.038s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:10:26 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9aa23f6c-ea56-4c4c-b57b-26cfc9c02655 tempest-VolumesActionsTest-628680531 None] Acquiring lock "cinder-2ddc72f7-a346-4441-bc5d-366e8eabcdad-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:10:26 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9aa23f6c-ea56-4c4c-b57b-26cfc9c02655 tempest-VolumesActionsTest-628680531 None] Lock "cinder-2ddc72f7-a346-4441-bc5d-366e8eabcdad-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:10:27 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9aa23f6c-ea56-4c4c-b57b-26cfc9c02655 tempest-VolumesActionsTest-628680531 None] Acquiring lock "cinder-quobyte-2ddc72f7-a346-4441-bc5d-366e8eabcdad" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:10:27 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9aa23f6c-ea56-4c4c-b57b-26cfc9c02655 tempest-VolumesActionsTest-628680531 None] Lock "cinder-quobyte-2ddc72f7-a346-4441-bc5d-366e8eabcdad" acquired by "delete_volume" :: waited 0.019s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:10:27 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[68db5055-414d-4f08-bd77-40ab4be9e00a]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:10:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9aa23f6c-ea56-4c4c-b57b-26cfc9c02655 tempest-VolumesActionsTest-628680531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ddc72f7-a346-4441-bc5d-366e8eabcdad {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:27 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ddc72f7-a346-4441-bc5d-366e8eabcdad Sep 23 15:10:27 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:27 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9aa23f6c-ea56-4c4c-b57b-26cfc9c02655 tempest-VolumesActionsTest-628680531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ddc72f7-a346-4441-bc5d-366e8eabcdad" returned: 0 in 0.466s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9aa23f6c-ea56-4c4c-b57b-26cfc9c02655 tempest-VolumesActionsTest-628680531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ddc72f7-a346-4441-bc5d-366e8eabcdad {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:27 devstack sudo[90004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ddc72f7-a346-4441-bc5d-366e8eabcdad Sep 23 15:10:27 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:27 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9aa23f6c-ea56-4c4c-b57b-26cfc9c02655 tempest-VolumesActionsTest-628680531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ddc72f7-a346-4441-bc5d-366e8eabcdad" returned: 0 in 0.312s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:27 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9aa23f6c-ea56-4c4c-b57b-26cfc9c02655 tempest-VolumesActionsTest-628680531 None] Lock "cinder-quobyte-2ddc72f7-a346-4441-bc5d-366e8eabcdad" released by "delete_volume" :: held 0.852s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:10:27 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-9aa23f6c-ea56-4c4c-b57b-26cfc9c02655 tempest-VolumesActionsTest-628680531 None] Created reservations ['5d916b4e-b8b6-4a7a-8903-fb17868fdfd4', 'd5193774-deef-4be2-95c6-45acbae7a2e8', '6edbc51d-2d15-4c63-9208-db0f871c04b2', '9b4570da-146e-4b72-a463-e2f9127e3ad7'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:10:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9aa23f6c-ea56-4c4c-b57b-26cfc9c02655 tempest-VolumesActionsTest-628680531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9aa23f6c-ea56-4c4c-b57b-26cfc9c02655 tempest-VolumesActionsTest-628680531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9aa23f6c-ea56-4c4c-b57b-26cfc9c02655 tempest-VolumesActionsTest-628680531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:10:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9aa23f6c-ea56-4c4c-b57b-26cfc9c02655 tempest-VolumesActionsTest-628680531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:10:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9aa23f6c-ea56-4c4c-b57b-26cfc9c02655 tempest-VolumesActionsTest-628680531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9aa23f6c-ea56-4c4c-b57b-26cfc9c02655 tempest-VolumesActionsTest-628680531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:28 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:10:28 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:28 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9aa23f6c-ea56-4c4c-b57b-26cfc9c02655 tempest-VolumesActionsTest-628680531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.714s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:28 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-9aa23f6c-ea56-4c4c-b57b-26cfc9c02655 tempest-VolumesActionsTest-628680531 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:10:28 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-9aa23f6c-ea56-4c4c-b57b-26cfc9c02655 tempest-VolumesActionsTest-628680531 None] Deleted volume successfully. Sep 23 15:10:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9aa23f6c-ea56-4c4c-b57b-26cfc9c02655 tempest-VolumesActionsTest-628680531 None] Lock "cinder-2ddc72f7-a346-4441-bc5d-366e8eabcdad-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:10:32 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:10:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Flow 'volume_create_manager' (c8f1d8ac-775f-4b46-a0a2-99cbb7acfedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:10:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (579c75d7-fb42-4c14-9e4d-4a2b28d3f483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (579c75d7-fb42-4c14-9e4d-4a2b28d3f483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-668019626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc414d73-a479-4c87-ab51-8349f4f82333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84f3e54a41447f69a3cfa161a980c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:10:33Z,use_quota=True,user_id='6bdf04139f884ab198ad90dd81c0f982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d354c145-4fc6-40a6-a0af-577fa34392f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d354c145-4fc6-40a6-a0af-577fa34392f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (088b70a3-0201-4b27-8197-9e783400d761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (088b70a3-0201-4b27-8197-9e783400d761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc414d73-a479-4c87-ab51-8349f4f82333', 'volume_name': 'volume-fc414d73-a479-4c87-ab51-8349f4f82333', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (368246bb-7ec1-44c4-9ac4-d06e88c28baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (368246bb-7ec1-44c4-9ac4-d06e88c28baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f4538ad-dedd-4735-85e9-1d03a29f8360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:32 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Volume fc414d73-a479-4c87-ab51-8349f4f82333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc414d73-a479-4c87-ab51-8349f4f82333', 'volume_size': 1} Sep 23 15:10:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-668019626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc414d73-a479-4c87-ab51-8349f4f82333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84f3e54a41447f69a3cfa161a980c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:10:33Z,use_quota=True,user_id='6bdf04139f884ab198ad90dd81c0f982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:10:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Creating volume fc414d73-a479-4c87-ab51-8349f4f82333 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:10:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:10:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:10:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:10:32 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:10:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc414d73-a479-4c87-ab51-8349f4f82333 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:32 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc414d73-a479-4c87-ab51-8349f4f82333 1073741824 Sep 23 15:10:32 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:33 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc414d73-a479-4c87-ab51-8349f4f82333 1073741824" returned: 0 in 0.828s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc414d73-a479-4c87-ab51-8349f4f82333 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:33 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc414d73-a479-4c87-ab51-8349f4f82333 Sep 23 15:10:33 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:34 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc414d73-a479-4c87-ab51-8349f4f82333" returned: 0 in 0.381s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:10:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f4538ad-dedd-4735-85e9-1d03a29f8360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc414d73-a479-4c87-ab51-8349f4f82333', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1659087-e221-4be7-ab8c-23c7178e011e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:34 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Volume volume-fc414d73-a479-4c87-ab51-8349f4f82333 (fc414d73-a479-4c87-ab51-8349f4f82333): created successfully Sep 23 15:10:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1659087-e221-4be7-ab8c-23c7178e011e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Flow 'volume_create_manager' (c8f1d8ac-775f-4b46-a0a2-99cbb7acfedb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:10:34 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-803f9abe-6ad6-4666-a6b6-fcffb783267b tempest-VolumesActionsTest-628680531 None] Created volume successfully. Sep 23 15:10:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4b9899f2-55f9-4ab7-b5d9-6ff97c4b336c tempest-VolumesActionsTest-1060395896 None] Acquiring lock "cinder-fc414d73-a479-4c87-ab51-8349f4f82333-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:10:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4b9899f2-55f9-4ab7-b5d9-6ff97c4b336c tempest-VolumesActionsTest-1060395896 None] Lock "cinder-fc414d73-a479-4c87-ab51-8349f4f82333-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:10:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4b9899f2-55f9-4ab7-b5d9-6ff97c4b336c tempest-VolumesActionsTest-1060395896 None] Acquiring lock "cinder-quobyte-fc414d73-a479-4c87-ab51-8349f4f82333" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:10:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4b9899f2-55f9-4ab7-b5d9-6ff97c4b336c tempest-VolumesActionsTest-1060395896 None] Lock "cinder-quobyte-fc414d73-a479-4c87-ab51-8349f4f82333" acquired by "delete_volume" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:10:35 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[086e9181-875b-4382-b908-e67b5bc47e73]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:10:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4b9899f2-55f9-4ab7-b5d9-6ff97c4b336c tempest-VolumesActionsTest-1060395896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc414d73-a479-4c87-ab51-8349f4f82333 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:35 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc414d73-a479-4c87-ab51-8349f4f82333 Sep 23 15:10:35 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:35 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4b9899f2-55f9-4ab7-b5d9-6ff97c4b336c tempest-VolumesActionsTest-1060395896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc414d73-a479-4c87-ab51-8349f4f82333" returned: 0 in 0.615s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4b9899f2-55f9-4ab7-b5d9-6ff97c4b336c tempest-VolumesActionsTest-1060395896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc414d73-a479-4c87-ab51-8349f4f82333 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:36 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc414d73-a479-4c87-ab51-8349f4f82333 Sep 23 15:10:36 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:10:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:10:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:10:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:36 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:10:36 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:36 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4b9899f2-55f9-4ab7-b5d9-6ff97c4b336c tempest-VolumesActionsTest-1060395896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc414d73-a479-4c87-ab51-8349f4f82333" returned: 0 in 0.558s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:36 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.459s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:10:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4b9899f2-55f9-4ab7-b5d9-6ff97c4b336c tempest-VolumesActionsTest-1060395896 None] Lock "cinder-quobyte-fc414d73-a479-4c87-ab51-8349f4f82333" released by "delete_volume" :: held 1.264s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:10:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:10:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 8 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:10:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:10:36 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-4b9899f2-55f9-4ab7-b5d9-6ff97c4b336c tempest-VolumesActionsTest-1060395896 None] Created reservations ['ac485950-1c13-4b71-b496-6d7621fcc425', '4d9da211-8c91-4901-8c42-28c83fe4b2f4', 'c0be7351-82d0-489f-add4-a15854ea00a1', 'dad54fc2-1147-4f46-ba60-169599887bab'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:10:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4b9899f2-55f9-4ab7-b5d9-6ff97c4b336c tempest-VolumesActionsTest-1060395896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4b9899f2-55f9-4ab7-b5d9-6ff97c4b336c tempest-VolumesActionsTest-1060395896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4b9899f2-55f9-4ab7-b5d9-6ff97c4b336c tempest-VolumesActionsTest-1060395896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:10:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4b9899f2-55f9-4ab7-b5d9-6ff97c4b336c tempest-VolumesActionsTest-1060395896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:10:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4b9899f2-55f9-4ab7-b5d9-6ff97c4b336c tempest-VolumesActionsTest-1060395896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4b9899f2-55f9-4ab7-b5d9-6ff97c4b336c tempest-VolumesActionsTest-1060395896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:36 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:10:36 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:37 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4b9899f2-55f9-4ab7-b5d9-6ff97c4b336c tempest-VolumesActionsTest-1060395896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.397s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:37 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-4b9899f2-55f9-4ab7-b5d9-6ff97c4b336c tempest-VolumesActionsTest-1060395896 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:10:37 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-4b9899f2-55f9-4ab7-b5d9-6ff97c4b336c tempest-VolumesActionsTest-1060395896 None] Deleted volume successfully. Sep 23 15:10:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4b9899f2-55f9-4ab7-b5d9-6ff97c4b336c tempest-VolumesActionsTest-1060395896 None] Lock "cinder-fc414d73-a479-4c87-ab51-8349f4f82333-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:10:38 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:10:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Flow 'volume_create_manager' (a8a7987d-d5d5-4e7a-9762-57b037961e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:10:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8576fb76-91dc-44b7-8857-739f73861fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8576fb76-91dc-44b7-8857-739f73861fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-392729803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467ec99b-90e0-4544-afe1-7d2f63ecc554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84f3e54a41447f69a3cfa161a980c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:10:38Z,use_quota=True,user_id='6bdf04139f884ab198ad90dd81c0f982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0810c9-9953-49db-b8a7-2de05aace5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0810c9-9953-49db-b8a7-2de05aace5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022eb66a-8d9e-4b4c-a0fd-817bb29ce065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022eb66a-8d9e-4b4c-a0fd-817bb29ce065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '467ec99b-90e0-4544-afe1-7d2f63ecc554', 'volume_name': 'volume-467ec99b-90e0-4544-afe1-7d2f63ecc554', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce99a6b-ac3f-4703-91e6-19590e35d5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce99a6b-ac3f-4703-91e6-19590e35d5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744c0b92-059b-4a74-987b-592033aac767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:38 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Volume 467ec99b-90e0-4544-afe1-7d2f63ecc554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-467ec99b-90e0-4544-afe1-7d2f63ecc554', 'volume_size': 1} Sep 23 15:10:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-392729803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467ec99b-90e0-4544-afe1-7d2f63ecc554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84f3e54a41447f69a3cfa161a980c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:10:38Z,use_quota=True,user_id='6bdf04139f884ab198ad90dd81c0f982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:10:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Creating volume 467ec99b-90e0-4544-afe1-7d2f63ecc554 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:10:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:10:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:10:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:10:38 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:10:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-467ec99b-90e0-4544-afe1-7d2f63ecc554 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:38 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-467ec99b-90e0-4544-afe1-7d2f63ecc554 1073741824 Sep 23 15:10:38 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-836659b8-a112-43fb-972b-8a361e178df0 req-2313cf88-5b82-476a-beba-9bd2273f946c tempest-ServerActionsTestOtherA-977966886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:39 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-467ec99b-90e0-4544-afe1-7d2f63ecc554 1073741824" returned: 0 in 0.788s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-467ec99b-90e0-4544-afe1-7d2f63ecc554 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:39 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-467ec99b-90e0-4544-afe1-7d2f63ecc554 Sep 23 15:10:39 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:39 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-467ec99b-90e0-4544-afe1-7d2f63ecc554" returned: 0 in 0.275s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:10:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-836659b8-a112-43fb-972b-8a361e178df0 req-2313cf88-5b82-476a-beba-9bd2273f946c tempest-ServerActionsTestOtherA-977966886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.561s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744c0b92-059b-4a74-987b-592033aac767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-467ec99b-90e0-4544-afe1-7d2f63ecc554', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c761651-7af2-4567-8d76-ed6f3ae08527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-836659b8-a112-43fb-972b-8a361e178df0 req-2313cf88-5b82-476a-beba-9bd2273f946c tempest-ServerActionsTestOtherA-977966886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:39 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Volume volume-467ec99b-90e0-4544-afe1-7d2f63ecc554 (467ec99b-90e0-4544-afe1-7d2f63ecc554): created successfully Sep 23 15:10:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c761651-7af2-4567-8d76-ed6f3ae08527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Flow 'volume_create_manager' (a8a7987d-d5d5-4e7a-9762-57b037961e38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:10:40 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-836659b8-a112-43fb-972b-8a361e178df0 req-2313cf88-5b82-476a-beba-9bd2273f946c tempest-ServerActionsTestOtherA-977966886 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-fb778eb5-ab01-4cc7-9290-9db864c337ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3fd3267-9768-4a71-81b9-4e0ebd3ae63a', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:10:40 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-4eacdddb-db41-419d-9b31-162631d17bad tempest-VolumesActionsTest-628680531 None] Created volume successfully. Sep 23 15:10:40 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-836659b8-a112-43fb-972b-8a361e178df0 req-2313cf88-5b82-476a-beba-9bd2273f946c tempest-ServerActionsTestOtherA-977966886 None] attachment_update completed successfully. Sep 23 15:10:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bd02f43b-d235-4f62-a93a-c862d61c2a51 tempest-VolumesActionsTest-1060395896 None] Acquiring lock "cinder-467ec99b-90e0-4544-afe1-7d2f63ecc554-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:10:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bd02f43b-d235-4f62-a93a-c862d61c2a51 tempest-VolumesActionsTest-1060395896 None] Lock "cinder-467ec99b-90e0-4544-afe1-7d2f63ecc554-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:10:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bd02f43b-d235-4f62-a93a-c862d61c2a51 tempest-VolumesActionsTest-1060395896 None] Acquiring lock "cinder-quobyte-467ec99b-90e0-4544-afe1-7d2f63ecc554" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:10:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bd02f43b-d235-4f62-a93a-c862d61c2a51 tempest-VolumesActionsTest-1060395896 None] Lock "cinder-quobyte-467ec99b-90e0-4544-afe1-7d2f63ecc554" acquired by "delete_volume" :: waited 0.024s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:10:41 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b81ecf-4521-493f-98d1-c469b262eb1c]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:10:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bd02f43b-d235-4f62-a93a-c862d61c2a51 tempest-VolumesActionsTest-1060395896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-467ec99b-90e0-4544-afe1-7d2f63ecc554 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:41 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-467ec99b-90e0-4544-afe1-7d2f63ecc554 Sep 23 15:10:41 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:41 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bd02f43b-d235-4f62-a93a-c862d61c2a51 tempest-VolumesActionsTest-1060395896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-467ec99b-90e0-4544-afe1-7d2f63ecc554" returned: 0 in 0.520s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bd02f43b-d235-4f62-a93a-c862d61c2a51 tempest-VolumesActionsTest-1060395896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-467ec99b-90e0-4544-afe1-7d2f63ecc554 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:41 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-467ec99b-90e0-4544-afe1-7d2f63ecc554 Sep 23 15:10:41 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:42 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bd02f43b-d235-4f62-a93a-c862d61c2a51 tempest-VolumesActionsTest-1060395896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-467ec99b-90e0-4544-afe1-7d2f63ecc554" returned: 0 in 0.756s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:42 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bd02f43b-d235-4f62-a93a-c862d61c2a51 tempest-VolumesActionsTest-1060395896 None] Lock "cinder-quobyte-467ec99b-90e0-4544-afe1-7d2f63ecc554" released by "delete_volume" :: held 1.385s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:10:42 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-bd02f43b-d235-4f62-a93a-c862d61c2a51 tempest-VolumesActionsTest-1060395896 None] Created reservations ['ff0becc6-c761-4f2c-aa31-d6ca7a4cc83e', '28504601-37e6-49fd-8336-26029845f309', '9a6caec3-91a0-45d3-9ed2-22decf895906', '31929a45-ba50-4c47-9283-781145311165'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:10:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bd02f43b-d235-4f62-a93a-c862d61c2a51 tempest-VolumesActionsTest-1060395896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bd02f43b-d235-4f62-a93a-c862d61c2a51 tempest-VolumesActionsTest-1060395896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:42 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bd02f43b-d235-4f62-a93a-c862d61c2a51 tempest-VolumesActionsTest-1060395896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:10:42 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bd02f43b-d235-4f62-a93a-c862d61c2a51 tempest-VolumesActionsTest-1060395896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:10:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bd02f43b-d235-4f62-a93a-c862d61c2a51 tempest-VolumesActionsTest-1060395896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bd02f43b-d235-4f62-a93a-c862d61c2a51 tempest-VolumesActionsTest-1060395896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:43 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:10:43 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:43 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bd02f43b-d235-4f62-a93a-c862d61c2a51 tempest-VolumesActionsTest-1060395896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.564s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:43 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-bd02f43b-d235-4f62-a93a-c862d61c2a51 tempest-VolumesActionsTest-1060395896 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:10:43 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-bd02f43b-d235-4f62-a93a-c862d61c2a51 tempest-VolumesActionsTest-1060395896 None] Deleted volume successfully. Sep 23 15:10:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bd02f43b-d235-4f62-a93a-c862d61c2a51 tempest-VolumesActionsTest-1060395896 None] Lock "cinder-467ec99b-90e0-4544-afe1-7d2f63ecc554-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:10:45 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:10:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Flow 'volume_create_manager' (b25c0ed4-3a05-421b-9356-9eaac9bbe5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:10:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3140c5db-2446-494f-b29e-0dc2755e7b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3140c5db-2446-494f-b29e-0dc2755e7b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2052887302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c646703-26de-479e-b5cb-71c7d72051c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84f3e54a41447f69a3cfa161a980c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:10:45Z,use_quota=True,user_id='6bdf04139f884ab198ad90dd81c0f982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71cfd5f-94a4-4385-a957-2e2d916e2b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71cfd5f-94a4-4385-a957-2e2d916e2b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc3a6e9-6350-4f62-a476-b0ea4ca3feb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc3a6e9-6350-4f62-a476-b0ea4ca3feb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c646703-26de-479e-b5cb-71c7d72051c2', 'volume_name': 'volume-1c646703-26de-479e-b5cb-71c7d72051c2', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d537ce7-cec2-4705-9a2b-870cbbe7ba33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d537ce7-cec2-4705-9a2b-870cbbe7ba33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec97bf8b-288a-453e-bed0-6d5c32bd62b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:45 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Volume 1c646703-26de-479e-b5cb-71c7d72051c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c646703-26de-479e-b5cb-71c7d72051c2', 'volume_size': 1} Sep 23 15:10:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:45 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2052887302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c646703-26de-479e-b5cb-71c7d72051c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84f3e54a41447f69a3cfa161a980c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:10:45Z,use_quota=True,user_id='6bdf04139f884ab198ad90dd81c0f982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:10:45 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Creating volume 1c646703-26de-479e-b5cb-71c7d72051c2 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:10:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:45 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:10:45 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:10:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:45 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:10:45 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:10:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1c646703-26de-479e-b5cb-71c7d72051c2 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:45 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1c646703-26de-479e-b5cb-71c7d72051c2 1073741824 Sep 23 15:10:45 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:46 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1c646703-26de-479e-b5cb-71c7d72051c2 1073741824" returned: 0 in 0.849s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:46 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-4981a3cb-07fa-43e8-a625-97ed24c7d8ab req-1f58b1a9-8d23-43f7-bc37-760783fb8d0c tempest-ServerActionsTestOtherA-977966886 None] Terminate volume connection completed successfully. Sep 23 15:10:46 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-4981a3cb-07fa-43e8-a625-97ed24c7d8ab req-1f58b1a9-8d23-43f7-bc37-760783fb8d0c tempest-ServerActionsTestOtherA-977966886 None] Deleting attachment f3fd3267-9768-4a71-81b9-4e0ebd3ae63a. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:10:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1c646703-26de-479e-b5cb-71c7d72051c2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:46 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1c646703-26de-479e-b5cb-71c7d72051c2 Sep 23 15:10:46 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:46 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1c646703-26de-479e-b5cb-71c7d72051c2" returned: 0 in 0.688s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:10:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec97bf8b-288a-453e-bed0-6d5c32bd62b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c646703-26de-479e-b5cb-71c7d72051c2', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cbc0cfc-f859-42c4-b8b5-b06e8d496801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:47 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Volume volume-1c646703-26de-479e-b5cb-71c7d72051c2 (1c646703-26de-479e-b5cb-71c7d72051c2): created successfully Sep 23 15:10:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cbc0cfc-f859-42c4-b8b5-b06e8d496801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Flow 'volume_create_manager' (b25c0ed4-3a05-421b-9356-9eaac9bbe5d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:10:47 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-0d8ffdb9-ded6-4b93-9e54-48db2cd7337b tempest-VolumesActionsTest-628680531 None] Created volume successfully. Sep 23 15:10:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-4981a3cb-07fa-43e8-a625-97ed24c7d8ab req-d57ba2b9-9743-4158-83af-ad6c1d2d1b2f tempest-ServerActionsTestOtherA-977966886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-4981a3cb-07fa-43e8-a625-97ed24c7d8ab req-d57ba2b9-9743-4158-83af-ad6c1d2d1b2f tempest-ServerActionsTestOtherA-977966886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-4981a3cb-07fa-43e8-a625-97ed24c7d8ab req-d57ba2b9-9743-4158-83af-ad6c1d2d1b2f tempest-ServerActionsTestOtherA-977966886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-4981a3cb-07fa-43e8-a625-97ed24c7d8ab req-d57ba2b9-9743-4158-83af-ad6c1d2d1b2f tempest-ServerActionsTestOtherA-977966886 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-fb778eb5-ab01-4cc7-9290-9db864c337ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb786967-2074-415a-8ce0-3f11bc3f172c', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:10:47 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-4981a3cb-07fa-43e8-a625-97ed24c7d8ab req-d57ba2b9-9743-4158-83af-ad6c1d2d1b2f tempest-ServerActionsTestOtherA-977966886 None] attachment_update completed successfully. Sep 23 15:10:48 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-000f264d-582c-452e-a9de-e91e8c977147 tempest-VolumesActionsTest-1060395896 None] Acquiring lock "cinder-1c646703-26de-479e-b5cb-71c7d72051c2-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:10:48 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-000f264d-582c-452e-a9de-e91e8c977147 tempest-VolumesActionsTest-1060395896 None] Lock "cinder-1c646703-26de-479e-b5cb-71c7d72051c2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:10:48 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-000f264d-582c-452e-a9de-e91e8c977147 tempest-VolumesActionsTest-1060395896 None] Acquiring lock "cinder-quobyte-1c646703-26de-479e-b5cb-71c7d72051c2" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:10:48 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-000f264d-582c-452e-a9de-e91e8c977147 tempest-VolumesActionsTest-1060395896 None] Lock "cinder-quobyte-1c646703-26de-479e-b5cb-71c7d72051c2" acquired by "delete_volume" :: waited 0.028s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:10:48 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c3f99f-c0c7-4601-ba9c-bf064509dcdd]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:10:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-000f264d-582c-452e-a9de-e91e8c977147 tempest-VolumesActionsTest-1060395896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1c646703-26de-479e-b5cb-71c7d72051c2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:48 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1c646703-26de-479e-b5cb-71c7d72051c2 Sep 23 15:10:48 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:49 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-000f264d-582c-452e-a9de-e91e8c977147 tempest-VolumesActionsTest-1060395896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1c646703-26de-479e-b5cb-71c7d72051c2" returned: 0 in 0.432s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-000f264d-582c-452e-a9de-e91e8c977147 tempest-VolumesActionsTest-1060395896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1c646703-26de-479e-b5cb-71c7d72051c2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:49 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1c646703-26de-479e-b5cb-71c7d72051c2 Sep 23 15:10:49 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:49 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-000f264d-582c-452e-a9de-e91e8c977147 tempest-VolumesActionsTest-1060395896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1c646703-26de-479e-b5cb-71c7d72051c2" returned: 0 in 0.320s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-000f264d-582c-452e-a9de-e91e8c977147 tempest-VolumesActionsTest-1060395896 None] Lock "cinder-quobyte-1c646703-26de-479e-b5cb-71c7d72051c2" released by "delete_volume" :: held 0.819s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:10:49 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-000f264d-582c-452e-a9de-e91e8c977147 tempest-VolumesActionsTest-1060395896 None] Created reservations ['16847a2f-f96b-4e36-9f38-af1aa15f1a90', 'a563e977-3e46-4db6-915a-d8fbc7fe7c35', 'bd044ae7-69b8-4076-a8a6-4a73506dc1df', '2daf93bf-eb84-4353-bd2a-ae4b8f5f96a1'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:10:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-000f264d-582c-452e-a9de-e91e8c977147 tempest-VolumesActionsTest-1060395896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-000f264d-582c-452e-a9de-e91e8c977147 tempest-VolumesActionsTest-1060395896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-000f264d-582c-452e-a9de-e91e8c977147 tempest-VolumesActionsTest-1060395896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:10:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-000f264d-582c-452e-a9de-e91e8c977147 tempest-VolumesActionsTest-1060395896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:10:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-000f264d-582c-452e-a9de-e91e8c977147 tempest-VolumesActionsTest-1060395896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-000f264d-582c-452e-a9de-e91e8c977147 tempest-VolumesActionsTest-1060395896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:49 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:10:49 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:50 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-000f264d-582c-452e-a9de-e91e8c977147 tempest-VolumesActionsTest-1060395896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.599s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:50 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-000f264d-582c-452e-a9de-e91e8c977147 tempest-VolumesActionsTest-1060395896 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:10:50 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-000f264d-582c-452e-a9de-e91e8c977147 tempest-VolumesActionsTest-1060395896 None] Deleted volume successfully. Sep 23 15:10:50 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-000f264d-582c-452e-a9de-e91e8c977147 tempest-VolumesActionsTest-1060395896 None] Lock "cinder-1c646703-26de-479e-b5cb-71c7d72051c2-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:10:50 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:10:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Flow 'volume_create_manager' (c6bb5744-fa7f-45b2-aacb-d8c2d5f01017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:10:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f453e75-1cf7-4ad9-aa88-6cc61aa6278f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f453e75-1cf7-4ad9-aa88-6cc61aa6278f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1439711426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ff348f-bf55-4cab-9146-f70bfe620838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84f3e54a41447f69a3cfa161a980c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:10:51Z,use_quota=True,user_id='6bdf04139f884ab198ad90dd81c0f982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9012ee78-56e6-4787-bb38-e8e31734fab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9012ee78-56e6-4787-bb38-e8e31734fab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bff6d93-a049-44c6-8c4c-a9cd86e54c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bff6d93-a049-44c6-8c4c-a9cd86e54c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4ff348f-bf55-4cab-9146-f70bfe620838', 'volume_name': 'volume-e4ff348f-bf55-4cab-9146-f70bfe620838', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89324535-8a02-4007-ab22-eaaa8eabd955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89324535-8a02-4007-ab22-eaaa8eabd955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3fe7559-d743-4c11-b075-5dc87d757452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:51 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Volume e4ff348f-bf55-4cab-9146-f70bfe620838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4ff348f-bf55-4cab-9146-f70bfe620838', 'volume_size': 1} Sep 23 15:10:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1439711426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ff348f-bf55-4cab-9146-f70bfe620838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84f3e54a41447f69a3cfa161a980c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:10:51Z,use_quota=True,user_id='6bdf04139f884ab198ad90dd81c0f982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:10:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Creating volume e4ff348f-bf55-4cab-9146-f70bfe620838 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:10:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:10:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:10:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:10:51 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:10:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4ff348f-bf55-4cab-9146-f70bfe620838 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:51 devstack sudo[91235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4ff348f-bf55-4cab-9146-f70bfe620838 1073741824 Sep 23 15:10:51 devstack sudo[91235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:51 devstack sudo[91235]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4ff348f-bf55-4cab-9146-f70bfe620838 1073741824" returned: 0 in 0.524s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4ff348f-bf55-4cab-9146-f70bfe620838 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:51 devstack sudo[91252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4ff348f-bf55-4cab-9146-f70bfe620838 Sep 23 15:10:51 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:52 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4ff348f-bf55-4cab-9146-f70bfe620838" returned: 0 in 0.482s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:10:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3fe7559-d743-4c11-b075-5dc87d757452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4ff348f-bf55-4cab-9146-f70bfe620838', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc7acb31-c530-4996-af68-b09fe4a1f049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:52 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Volume volume-e4ff348f-bf55-4cab-9146-f70bfe620838 (e4ff348f-bf55-4cab-9146-f70bfe620838): created successfully Sep 23 15:10:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc7acb31-c530-4996-af68-b09fe4a1f049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Flow 'volume_create_manager' (c6bb5744-fa7f-45b2-aacb-d8c2d5f01017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:10:52 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-42ca54cf-463a-4db7-b52f-2ab0397bb29f tempest-VolumesActionsTest-628680531 None] Created volume successfully. Sep 23 15:10:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2e2c815b-a1ee-4da7-b7d0-8ec54f1c2525 tempest-VolumesActionsTest-1060395896 None] Acquiring lock "cinder-e4ff348f-bf55-4cab-9146-f70bfe620838-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:10:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2e2c815b-a1ee-4da7-b7d0-8ec54f1c2525 tempest-VolumesActionsTest-1060395896 None] Lock "cinder-e4ff348f-bf55-4cab-9146-f70bfe620838-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:10:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2e2c815b-a1ee-4da7-b7d0-8ec54f1c2525 tempest-VolumesActionsTest-1060395896 None] Acquiring lock "cinder-quobyte-e4ff348f-bf55-4cab-9146-f70bfe620838" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:10:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2e2c815b-a1ee-4da7-b7d0-8ec54f1c2525 tempest-VolumesActionsTest-1060395896 None] Lock "cinder-quobyte-e4ff348f-bf55-4cab-9146-f70bfe620838" acquired by "delete_volume" :: waited 0.027s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:10:53 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[468600a9-a245-42a7-9762-7dc466354ffd]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:10:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2e2c815b-a1ee-4da7-b7d0-8ec54f1c2525 tempest-VolumesActionsTest-1060395896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4ff348f-bf55-4cab-9146-f70bfe620838 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:53 devstack sudo[91257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4ff348f-bf55-4cab-9146-f70bfe620838 Sep 23 15:10:53 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:54 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2e2c815b-a1ee-4da7-b7d0-8ec54f1c2525 tempest-VolumesActionsTest-1060395896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4ff348f-bf55-4cab-9146-f70bfe620838" returned: 0 in 0.507s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2e2c815b-a1ee-4da7-b7d0-8ec54f1c2525 tempest-VolumesActionsTest-1060395896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4ff348f-bf55-4cab-9146-f70bfe620838 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:54 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4ff348f-bf55-4cab-9146-f70bfe620838 Sep 23 15:10:54 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:54 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2e2c815b-a1ee-4da7-b7d0-8ec54f1c2525 tempest-VolumesActionsTest-1060395896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4ff348f-bf55-4cab-9146-f70bfe620838" returned: 0 in 0.362s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:54 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2e2c815b-a1ee-4da7-b7d0-8ec54f1c2525 tempest-VolumesActionsTest-1060395896 None] Lock "cinder-quobyte-e4ff348f-bf55-4cab-9146-f70bfe620838" released by "delete_volume" :: held 0.946s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:10:54 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-2e2c815b-a1ee-4da7-b7d0-8ec54f1c2525 tempest-VolumesActionsTest-1060395896 None] Created reservations ['c18d6416-35cc-4556-8510-2bdf3016ade4', '46c77cec-2f88-4a75-b64a-a1d5a66f7d5c', '3c51a4fd-bc21-4cce-b3b5-b53f7128fc4e', 'bb015b14-4c45-4fb2-b78a-d33bdbc4ab31'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:10:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2e2c815b-a1ee-4da7-b7d0-8ec54f1c2525 tempest-VolumesActionsTest-1060395896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2e2c815b-a1ee-4da7-b7d0-8ec54f1c2525 tempest-VolumesActionsTest-1060395896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2e2c815b-a1ee-4da7-b7d0-8ec54f1c2525 tempest-VolumesActionsTest-1060395896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:10:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2e2c815b-a1ee-4da7-b7d0-8ec54f1c2525 tempest-VolumesActionsTest-1060395896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:10:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2e2c815b-a1ee-4da7-b7d0-8ec54f1c2525 tempest-VolumesActionsTest-1060395896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2e2c815b-a1ee-4da7-b7d0-8ec54f1c2525 tempest-VolumesActionsTest-1060395896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:54 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:10:54 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:54 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2e2c815b-a1ee-4da7-b7d0-8ec54f1c2525 tempest-VolumesActionsTest-1060395896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.312s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:54 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-2e2c815b-a1ee-4da7-b7d0-8ec54f1c2525 tempest-VolumesActionsTest-1060395896 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:10:55 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-2e2c815b-a1ee-4da7-b7d0-8ec54f1c2525 tempest-VolumesActionsTest-1060395896 None] Deleted volume successfully. Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2e2c815b-a1ee-4da7-b7d0-8ec54f1c2525 tempest-VolumesActionsTest-1060395896 None] Lock "cinder-e4ff348f-bf55-4cab-9146-f70bfe620838-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Flow 'volume_create_manager' (fc3f1bbf-a6c8-4a0d-aeb2-54685657fac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd92544-a851-42d6-83b1-d1979870a012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd92544-a851-42d6-83b1-d1979870a012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1069467473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1fce8ba-eb5d-4312-a120-358958a2c49d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f34b7110daa042c78f84281da7b22323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:10:55Z,use_quota=True,user_id='3690243cf76a438db6e500e0b4e7b8e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aae815ce-2c0a-4661-ab77-8679f30fd333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aae815ce-2c0a-4661-ab77-8679f30fd333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c18154-817e-45a4-bd28-b20112cedd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c18154-817e-45a4-bd28-b20112cedd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1fce8ba-eb5d-4312-a120-358958a2c49d', 'volume_name': 'volume-b1fce8ba-eb5d-4312-a120-358958a2c49d', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3c506c-b047-4078-ab8a-5819c3f195f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3c506c-b047-4078-ab8a-5819c3f195f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d614170-9baa-471d-a1a9-ee93bc0c9ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:55 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Volume b1fce8ba-eb5d-4312-a120-358958a2c49d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1fce8ba-eb5d-4312-a120-358958a2c49d', 'volume_size': 1} Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1069467473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1fce8ba-eb5d-4312-a120-358958a2c49d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f34b7110daa042c78f84281da7b22323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:10:55Z,use_quota=True,user_id='3690243cf76a438db6e500e0b4e7b8e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Creating volume b1fce8ba-eb5d-4312-a120-358958a2c49d {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:10:55 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b1fce8ba-eb5d-4312-a120-358958a2c49d 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:55 devstack sudo[91271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b1fce8ba-eb5d-4312-a120-358958a2c49d 1073741824 Sep 23 15:10:55 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:55 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b1fce8ba-eb5d-4312-a120-358958a2c49d 1073741824" returned: 0 in 0.540s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b1fce8ba-eb5d-4312-a120-358958a2c49d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:56 devstack sudo[91279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b1fce8ba-eb5d-4312-a120-358958a2c49d Sep 23 15:10:56 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:56 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b1fce8ba-eb5d-4312-a120-358958a2c49d" returned: 0 in 0.446s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d614170-9baa-471d-a1a9-ee93bc0c9ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1fce8ba-eb5d-4312-a120-358958a2c49d', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ffcbbdf-221a-491e-8b65-e491ab8a33ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Flow 'volume_create_manager' (797a7bfb-fa4c-40d0-98e9-f26e907c3470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc63678-7eab-49c6-a6bd-0346b317496e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:56 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Volume volume-b1fce8ba-eb5d-4312-a120-358958a2c49d (b1fce8ba-eb5d-4312-a120-358958a2c49d): created successfully Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ffcbbdf-221a-491e-8b65-e491ab8a33ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Flow 'volume_create_manager' (fc3f1bbf-a6c8-4a0d-aeb2-54685657fac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc63678-7eab-49c6-a6bd-0346b317496e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-547125318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71542e4a-e58b-46a8-ab34-4558b2b28ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84f3e54a41447f69a3cfa161a980c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:10:56Z,use_quota=True,user_id='6bdf04139f884ab198ad90dd81c0f982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f2e97e8-92ab-4e7a-881b-ca4bf9d428f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f2e97e8-92ab-4e7a-881b-ca4bf9d428f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c11eb23-06b9-4d60-8f9a-66c7dc84bc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c11eb23-06b9-4d60-8f9a-66c7dc84bc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71542e4a-e58b-46a8-ab34-4558b2b28ac0', 'volume_name': 'volume-71542e4a-e58b-46a8-ab34-4558b2b28ac0', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42a0353-feea-4c69-9848-6c9d0b1b10c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42a0353-feea-4c69-9848-6c9d0b1b10c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e35908-9a26-430f-bf3f-4d9b001363e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:56 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Volume 71542e4a-e58b-46a8-ab34-4558b2b28ac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71542e4a-e58b-46a8-ab34-4558b2b28ac0', 'volume_size': 1} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-547125318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71542e4a-e58b-46a8-ab34-4558b2b28ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84f3e54a41447f69a3cfa161a980c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:10:56Z,use_quota=True,user_id='6bdf04139f884ab198ad90dd81c0f982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Creating volume 71542e4a-e58b-46a8-ab34-4558b2b28ac0 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:10:56 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:10:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-71542e4a-e58b-46a8-ab34-4558b2b28ac0 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:56 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5db9165a-807a-41af-bbf5-530edb0159ae tempest-AttachVolumeNegativeTest-588753607 None] Created volume successfully. Sep 23 15:10:56 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-71542e4a-e58b-46a8-ab34-4558b2b28ac0 1073741824 Sep 23 15:10:56 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:57 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-71542e4a-e58b-46a8-ab34-4558b2b28ac0 1073741824" returned: 0 in 0.412s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-71542e4a-e58b-46a8-ab34-4558b2b28ac0 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:57 devstack sudo[91287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-71542e4a-e58b-46a8-ab34-4558b2b28ac0 Sep 23 15:10:57 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:57 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-71542e4a-e58b-46a8-ab34-4558b2b28ac0" returned: 0 in 0.292s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:10:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e35908-9a26-430f-bf3f-4d9b001363e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71542e4a-e58b-46a8-ab34-4558b2b28ac0', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd3d5e0-6340-4990-b825-985ccbe0ed70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:10:57 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Volume volume-71542e4a-e58b-46a8-ab34-4558b2b28ac0 (71542e4a-e58b-46a8-ab34-4558b2b28ac0): created successfully Sep 23 15:10:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd3d5e0-6340-4990-b825-985ccbe0ed70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:10:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Flow 'volume_create_manager' (797a7bfb-fa4c-40d0-98e9-f26e907c3470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:10:57 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-3f4e9b24-08eb-4b03-a02a-021178f146fc tempest-VolumesActionsTest-628680531 None] Created volume successfully. Sep 23 15:10:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-d7b57837-c177-4932-863a-63fc8a02c297 req-1a2478b8-90c4-45cd-921d-d328876a4e50 tempest-AttachVolumeNegativeTest-588753607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:10:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-d7b57837-c177-4932-863a-63fc8a02c297 req-1a2478b8-90c4-45cd-921d-d328876a4e50 tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:10:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-d7b57837-c177-4932-863a-63fc8a02c297 req-1a2478b8-90c4-45cd-921d-d328876a4e50 tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:10:58 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-d7b57837-c177-4932-863a-63fc8a02c297 req-1a2478b8-90c4-45cd-921d-d328876a4e50 tempest-AttachVolumeNegativeTest-588753607 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-b1fce8ba-eb5d-4312-a120-358958a2c49d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7094e14f-837e-4d05-8bd0-ac0f29b0dac1', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:10:58 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-d7b57837-c177-4932-863a-63fc8a02c297 req-1a2478b8-90c4-45cd-921d-d328876a4e50 tempest-AttachVolumeNegativeTest-588753607 None] attachment_update completed successfully. Sep 23 15:10:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0c506483-1a68-4c2d-b3f1-b1de4f7ba53d tempest-VolumesActionsTest-628680531 None] Acquiring lock "cinder-71542e4a-e58b-46a8-ab34-4558b2b28ac0-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:10:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0c506483-1a68-4c2d-b3f1-b1de4f7ba53d tempest-VolumesActionsTest-628680531 None] Lock "cinder-71542e4a-e58b-46a8-ab34-4558b2b28ac0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:10:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0c506483-1a68-4c2d-b3f1-b1de4f7ba53d tempest-VolumesActionsTest-628680531 None] Acquiring lock "cinder-quobyte-71542e4a-e58b-46a8-ab34-4558b2b28ac0" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:10:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0c506483-1a68-4c2d-b3f1-b1de4f7ba53d tempest-VolumesActionsTest-628680531 None] Lock "cinder-quobyte-71542e4a-e58b-46a8-ab34-4558b2b28ac0" acquired by "delete_volume" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:10:59 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb90c4d-f663-41e1-9fcf-34897ff4abc4]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:10:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0c506483-1a68-4c2d-b3f1-b1de4f7ba53d tempest-VolumesActionsTest-628680531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-71542e4a-e58b-46a8-ab34-4558b2b28ac0 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:59 devstack sudo[91337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-71542e4a-e58b-46a8-ab34-4558b2b28ac0 Sep 23 15:10:59 devstack sudo[91337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:10:59 devstack sudo[91337]: pam_unix(sudo:session): session closed for user root Sep 23 15:10:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0c506483-1a68-4c2d-b3f1-b1de4f7ba53d tempest-VolumesActionsTest-628680531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-71542e4a-e58b-46a8-ab34-4558b2b28ac0" returned: 0 in 0.417s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:10:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0c506483-1a68-4c2d-b3f1-b1de4f7ba53d tempest-VolumesActionsTest-628680531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-71542e4a-e58b-46a8-ab34-4558b2b28ac0 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:10:59 devstack sudo[91342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-71542e4a-e58b-46a8-ab34-4558b2b28ac0 Sep 23 15:10:59 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:00 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0c506483-1a68-4c2d-b3f1-b1de4f7ba53d tempest-VolumesActionsTest-628680531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-71542e4a-e58b-46a8-ab34-4558b2b28ac0" returned: 0 in 0.301s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:00 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0c506483-1a68-4c2d-b3f1-b1de4f7ba53d tempest-VolumesActionsTest-628680531 None] Lock "cinder-quobyte-71542e4a-e58b-46a8-ab34-4558b2b28ac0" released by "delete_volume" :: held 0.774s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:11:00 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-0c506483-1a68-4c2d-b3f1-b1de4f7ba53d tempest-VolumesActionsTest-628680531 None] Created reservations ['e78bf3f3-2caa-4885-b7c1-c3207fab9e81', '0d395dd6-da6a-4917-8a80-44382b9f0802', '3922b73b-a95c-4f94-9bec-6956e7ed38ef', '613e758f-4d14-4363-bb8e-6329c461bcd2'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:11:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0c506483-1a68-4c2d-b3f1-b1de4f7ba53d tempest-VolumesActionsTest-628680531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:11:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0c506483-1a68-4c2d-b3f1-b1de4f7ba53d tempest-VolumesActionsTest-628680531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:11:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0c506483-1a68-4c2d-b3f1-b1de4f7ba53d tempest-VolumesActionsTest-628680531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:11:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0c506483-1a68-4c2d-b3f1-b1de4f7ba53d tempest-VolumesActionsTest-628680531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:11:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0c506483-1a68-4c2d-b3f1-b1de4f7ba53d tempest-VolumesActionsTest-628680531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:11:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0c506483-1a68-4c2d-b3f1-b1de4f7ba53d tempest-VolumesActionsTest-628680531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:00 devstack sudo[91347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:11:00 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:00 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-4ae4905b-7174-445c-a2a9-50155e87f1d2 req-aaec407b-c988-479b-8f56-aba21020380a tempest-AttachVolumeNegativeTest-588753607 None] Terminate volume connection completed successfully. Sep 23 15:11:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-4ae4905b-7174-445c-a2a9-50155e87f1d2 req-aaec407b-c988-479b-8f56-aba21020380a tempest-AttachVolumeNegativeTest-588753607 None] Deleting attachment 7094e14f-837e-4d05-8bd0-ac0f29b0dac1. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:11:00 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0c506483-1a68-4c2d-b3f1-b1de4f7ba53d tempest-VolumesActionsTest-628680531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.367s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:00 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-0c506483-1a68-4c2d-b3f1-b1de4f7ba53d tempest-VolumesActionsTest-628680531 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:11:00 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-0c506483-1a68-4c2d-b3f1-b1de4f7ba53d tempest-VolumesActionsTest-628680531 None] Deleted volume successfully. Sep 23 15:11:00 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0c506483-1a68-4c2d-b3f1-b1de4f7ba53d tempest-VolumesActionsTest-628680531 None] Lock "cinder-71542e4a-e58b-46a8-ab34-4558b2b28ac0-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:11:08 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:11:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Flow 'volume_create_manager' (509ab662-7f69-49c5-8f9f-eb80eb8974ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:11:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140d2036-4c22-4b41-9747-9b933189e66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140d2036-4c22-4b41-9747-9b933189e66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-610249859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9812c9fc-8d78-4213-8f31-f2563064916c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db385e1f8f7847a4ab6b2216dfc672a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:11:08Z,use_quota=True,user_id='eff0434e2acf440785036ee28fd0c571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3769c207-2af3-49e0-b776-421626eb7cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3769c207-2af3-49e0-b776-421626eb7cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fafb79b7-b1f9-4a60-8d38-b8e95be15e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fafb79b7-b1f9-4a60-8d38-b8e95be15e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9812c9fc-8d78-4213-8f31-f2563064916c', 'volume_name': 'volume-9812c9fc-8d78-4213-8f31-f2563064916c', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8db9c6-db32-4e56-9ed1-24c88b8f337f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8db9c6-db32-4e56-9ed1-24c88b8f337f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3437f662-5fd7-481b-90a5-8e185eebab20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:08 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Volume 9812c9fc-8d78-4213-8f31-f2563064916c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9812c9fc-8d78-4213-8f31-f2563064916c', 'volume_size': 1} Sep 23 15:11:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:11:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:11:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-610249859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9812c9fc-8d78-4213-8f31-f2563064916c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db385e1f8f7847a4ab6b2216dfc672a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:11:08Z,use_quota=True,user_id='eff0434e2acf440785036ee28fd0c571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:11:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Creating volume 9812c9fc-8d78-4213-8f31-f2563064916c {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:11:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:11:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:11:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:11:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:11:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:11:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:11:08 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:11:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9812c9fc-8d78-4213-8f31-f2563064916c 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:08 devstack sudo[91436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9812c9fc-8d78-4213-8f31-f2563064916c 1073741824 Sep 23 15:11:08 devstack sudo[91436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:09 devstack sudo[91436]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9812c9fc-8d78-4213-8f31-f2563064916c 1073741824" returned: 0 in 0.537s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9812c9fc-8d78-4213-8f31-f2563064916c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:09 devstack sudo[91442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9812c9fc-8d78-4213-8f31-f2563064916c Sep 23 15:11:09 devstack sudo[91442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:09 devstack sudo[91442]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9812c9fc-8d78-4213-8f31-f2563064916c" returned: 0 in 0.298s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:09 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:11:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:11:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3437f662-5fd7-481b-90a5-8e185eebab20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9812c9fc-8d78-4213-8f31-f2563064916c', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2c324ea-0e0b-4b49-8d94-4fe55f6dca67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:09 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Volume volume-9812c9fc-8d78-4213-8f31-f2563064916c (9812c9fc-8d78-4213-8f31-f2563064916c): created successfully Sep 23 15:11:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2c324ea-0e0b-4b49-8d94-4fe55f6dca67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Flow 'volume_create_manager' (509ab662-7f69-49c5-8f9f-eb80eb8974ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:11:09 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-02e9be66-5350-4555-a699-43d531c37eff tempest-AttachVolumeShelveTestJSON-1747534317 None] Created volume successfully. Sep 23 15:11:19 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:UPDATE=79,cinder:SELECT=70,cinder:DELETE=6,cinder:INSERT=17 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:11:19 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=80,cinder:UPDATE=81,cinder:INSERT=17,cinder:DELETE=8 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:11:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-53740ce7-af6d-4a1e-99c0-78f35f90e428 req-f93196ee-7edd-4bc9-a191-0746238147af tempest-AttachVolumeShelveTestJSON-1747534317 None] No connector for attachment c4bc81e8-49fa-419c-bdec-47949a9c88f3; skipping storage backend terminate_connection call. {{(pid=86064) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 23 15:11:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-53740ce7-af6d-4a1e-99c0-78f35f90e428 req-f93196ee-7edd-4bc9-a191-0746238147af tempest-AttachVolumeShelveTestJSON-1747534317 None] Deleting attachment c4bc81e8-49fa-419c-bdec-47949a9c88f3. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:11:25 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:11:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Flow 'volume_create_manager' (792cd6b1-9edb-4a1b-a5a7-0b061218502e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:11:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f66ba15-9eee-41ec-b654-c1eab5d36adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f66ba15-9eee-41ec-b654-c1eab5d36adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1540654951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c0afbe-c99f-42c6-b969-92d68fb065bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84441366e9a54345ab82d9c71df78cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:11:26Z,use_quota=True,user_id='35d16cfe4ac24d53ab56c71c6a126503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b0e1527-987d-40dd-9b1d-91d06960e09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b0e1527-987d-40dd-9b1d-91d06960e09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ab6dee-8708-4f9f-b0c1-d4975704b955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ab6dee-8708-4f9f-b0c1-d4975704b955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78c0afbe-c99f-42c6-b969-92d68fb065bf', 'volume_name': 'volume-78c0afbe-c99f-42c6-b969-92d68fb065bf', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff6cfb0-c0e6-429e-951f-9492e63ffa70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff6cfb0-c0e6-429e-951f-9492e63ffa70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7351bc-2357-4ecb-b777-b9036afa7ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:25 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Volume 78c0afbe-c99f-42c6-b969-92d68fb065bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78c0afbe-c99f-42c6-b969-92d68fb065bf', 'volume_size': 1} Sep 23 15:11:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:11:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:11:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1540654951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c0afbe-c99f-42c6-b969-92d68fb065bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84441366e9a54345ab82d9c71df78cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:11:26Z,use_quota=True,user_id='35d16cfe4ac24d53ab56c71c6a126503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:11:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Creating volume 78c0afbe-c99f-42c6-b969-92d68fb065bf {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:11:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:11:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:11:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:11:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:11:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:11:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:11:25 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:11:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:25 devstack sudo[91647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf 1073741824 Sep 23 15:11:25 devstack sudo[91647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:26 devstack sudo[91647]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf 1073741824" returned: 0 in 0.512s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:26 devstack sudo[91655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf Sep 23 15:11:26 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:26 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf" returned: 0 in 0.340s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:11:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:11:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7351bc-2357-4ecb-b777-b9036afa7ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78c0afbe-c99f-42c6-b969-92d68fb065bf', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87deb9cb-19e8-45de-9724-3399666508e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:26 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Volume volume-78c0afbe-c99f-42c6-b969-92d68fb065bf (78c0afbe-c99f-42c6-b969-92d68fb065bf): created successfully Sep 23 15:11:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87deb9cb-19e8-45de-9724-3399666508e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Flow 'volume_create_manager' (792cd6b1-9edb-4a1b-a5a7-0b061218502e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:11:26 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-6817735b-458d-4dbd-b524-09fbcf36fc30 tempest-SnapshotMetadataTestJSON-905060816 None] Created volume successfully. Sep 23 15:11:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f1a92324-1318-4d0a-9352-86bb66ff7d49 tempest-SnapshotMetadataTestJSON-905060816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:11:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f1a92324-1318-4d0a-9352-86bb66ff7d49 tempest-SnapshotMetadataTestJSON-905060816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:11:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f1a92324-1318-4d0a-9352-86bb66ff7d49 tempest-SnapshotMetadataTestJSON-905060816 None] Creating offline snapshot eee78797-edcd-4ecc-931c-9ee7680390e1 of volume 78c0afbe-c99f-42c6-b969-92d68fb065bf {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:11:28 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a221c2-11cc-49ba-93d5-fa7d6708ff37]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:11:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a92324-1318-4d0a-9352-86bb66ff7d49 tempest-SnapshotMetadataTestJSON-905060816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:28 devstack sudo[91659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf Sep 23 15:11:28 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:28 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a92324-1318-4d0a-9352-86bb66ff7d49 tempest-SnapshotMetadataTestJSON-905060816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf" returned: 0 in 0.438s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a92324-1318-4d0a-9352-86bb66ff7d49 tempest-SnapshotMetadataTestJSON-905060816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.eee78797-edcd-4ecc-931c-9ee7680390e1 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:28 devstack sudo[91664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.eee78797-edcd-4ecc-931c-9ee7680390e1 1G Sep 23 15:11:28 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:29 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a92324-1318-4d0a-9352-86bb66ff7d49 tempest-SnapshotMetadataTestJSON-905060816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.eee78797-edcd-4ecc-931c-9ee7680390e1 1G" returned: 0 in 0.538s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a92324-1318-4d0a-9352-86bb66ff7d49 tempest-SnapshotMetadataTestJSON-905060816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78c0afbe-c99f-42c6-b969-92d68fb065bf -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.eee78797-edcd-4ecc-931c-9ee7680390e1 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:29 devstack sudo[91671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78c0afbe-c99f-42c6-b969-92d68fb065bf -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.eee78797-edcd-4ecc-931c-9ee7680390e1 Sep 23 15:11:29 devstack sudo[91671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:29 devstack sudo[91671]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a92324-1318-4d0a-9352-86bb66ff7d49 tempest-SnapshotMetadataTestJSON-905060816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78c0afbe-c99f-42c6-b969-92d68fb065bf -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.eee78797-edcd-4ecc-931c-9ee7680390e1" returned: 0 in 0.286s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:29 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-f1a92324-1318-4d0a-9352-86bb66ff7d49 tempest-SnapshotMetadataTestJSON-905060816 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.eee78797-edcd-4ecc-931c-9ee7680390e1 is being set with open permissions: ugo+rw Sep 23 15:11:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a92324-1318-4d0a-9352-86bb66ff7d49 tempest-SnapshotMetadataTestJSON-905060816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.eee78797-edcd-4ecc-931c-9ee7680390e1 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:29 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.eee78797-edcd-4ecc-931c-9ee7680390e1 Sep 23 15:11:29 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:29 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a92324-1318-4d0a-9352-86bb66ff7d49 tempest-SnapshotMetadataTestJSON-905060816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.eee78797-edcd-4ecc-931c-9ee7680390e1" returned: 0 in 0.286s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a92324-1318-4d0a-9352-86bb66ff7d49 tempest-SnapshotMetadataTestJSON-905060816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:29 devstack sudo[91701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.info Sep 23 15:11:29 devstack sudo[91701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:30 devstack sudo[91701]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a92324-1318-4d0a-9352-86bb66ff7d49 tempest-SnapshotMetadataTestJSON-905060816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.info" returned: 0 in 0.312s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:30 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-f1a92324-1318-4d0a-9352-86bb66ff7d49 tempest-SnapshotMetadataTestJSON-905060816 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.info is being set with open permissions: ugo+rw Sep 23 15:11:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a92324-1318-4d0a-9352-86bb66ff7d49 tempest-SnapshotMetadataTestJSON-905060816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:30 devstack sudo[91713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.info Sep 23 15:11:30 devstack sudo[91713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:30 devstack sudo[91713]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a92324-1318-4d0a-9352-86bb66ff7d49 tempest-SnapshotMetadataTestJSON-905060816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.info" returned: 0 in 0.432s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f1a92324-1318-4d0a-9352-86bb66ff7d49 tempest-SnapshotMetadataTestJSON-905060816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.444s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:11:30 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f1a92324-1318-4d0a-9352-86bb66ff7d49 tempest-SnapshotMetadataTestJSON-905060816 None] Create snapshot completed successfully Sep 23 15:11:31 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-7ee3df69-fee6-4234-9802-610f7f789e90 req-3b0e81cc-3b7a-4224-9138-237d30305d3b tempest-ServerActionsTestOtherA-977966886 None] Terminate volume connection completed successfully. Sep 23 15:11:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-7ee3df69-fee6-4234-9802-610f7f789e90 req-3b0e81cc-3b7a-4224-9138-237d30305d3b tempest-ServerActionsTestOtherA-977966886 None] Deleting attachment cb786967-2074-415a-8ce0-3f11bc3f172c. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:11:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-67e9cc4c-678e-4a3d-ab1a-10fdcc5df5a7 tempest-SnapshotMetadataTestJSON-905060816 None] Acquiring lock "cinder-eee78797-edcd-4ecc-931c-9ee7680390e1-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:11:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-67e9cc4c-678e-4a3d-ab1a-10fdcc5df5a7 tempest-SnapshotMetadataTestJSON-905060816 None] Lock "cinder-eee78797-edcd-4ecc-931c-9ee7680390e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:11:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-67e9cc4c-678e-4a3d-ab1a-10fdcc5df5a7 tempest-SnapshotMetadataTestJSON-905060816 None] Acquiring lock "cinder-quobyte-78c0afbe-c99f-42c6-b969-92d68fb065bf" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:11:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-67e9cc4c-678e-4a3d-ab1a-10fdcc5df5a7 tempest-SnapshotMetadataTestJSON-905060816 None] Lock "cinder-quobyte-78c0afbe-c99f-42c6-b969-92d68fb065bf" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:11:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-67e9cc4c-678e-4a3d-ab1a-10fdcc5df5a7 tempest-SnapshotMetadataTestJSON-905060816 None] Acquiring lock "cinder-quobyte-eee78797-edcd-4ecc-931c-9ee7680390e1" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:11:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-67e9cc4c-678e-4a3d-ab1a-10fdcc5df5a7 tempest-SnapshotMetadataTestJSON-905060816 None] Lock "cinder-quobyte-eee78797-edcd-4ecc-931c-9ee7680390e1" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:11:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-67e9cc4c-678e-4a3d-ab1a-10fdcc5df5a7 tempest-SnapshotMetadataTestJSON-905060816 None] Deleting offline snapshot eee78797-edcd-4ecc-931c-9ee7680390e1 of volume 78c0afbe-c99f-42c6-b969-92d68fb065bf {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:11:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-67e9cc4c-678e-4a3d-ab1a-10fdcc5df5a7 tempest-SnapshotMetadataTestJSON-905060816 None] snapshot_file for this snap is: volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.eee78797-edcd-4ecc-931c-9ee7680390e1 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:11:33 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[84455f14-1b75-45d4-bf46-37d836eb9f26]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:11:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-67e9cc4c-678e-4a3d-ab1a-10fdcc5df5a7 tempest-SnapshotMetadataTestJSON-905060816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.eee78797-edcd-4ecc-931c-9ee7680390e1 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:33 devstack sudo[91749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.eee78797-edcd-4ecc-931c-9ee7680390e1 Sep 23 15:11:33 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:33 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-67e9cc4c-678e-4a3d-ab1a-10fdcc5df5a7 tempest-SnapshotMetadataTestJSON-905060816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.eee78797-edcd-4ecc-931c-9ee7680390e1" returned: 0 in 0.785s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-67e9cc4c-678e-4a3d-ab1a-10fdcc5df5a7 tempest-SnapshotMetadataTestJSON-905060816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78c0afbe-c99f-42c6-b969-92d68fb065bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:11:33 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdbc2fe-d6dd-453b-92df-199d024ebcd7]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:11:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-67e9cc4c-678e-4a3d-ab1a-10fdcc5df5a7 tempest-SnapshotMetadataTestJSON-905060816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:34 devstack sudo[91821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf Sep 23 15:11:34 devstack sudo[91821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:34 devstack sudo[91821]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-67e9cc4c-678e-4a3d-ab1a-10fdcc5df5a7 tempest-SnapshotMetadataTestJSON-905060816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf" returned: 0 in 0.649s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-67e9cc4c-678e-4a3d-ab1a-10fdcc5df5a7 tempest-SnapshotMetadataTestJSON-905060816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.eee78797-edcd-4ecc-931c-9ee7680390e1 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:34 devstack sudo[91843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.eee78797-edcd-4ecc-931c-9ee7680390e1 Sep 23 15:11:34 devstack sudo[91843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:35 devstack sudo[91843]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-67e9cc4c-678e-4a3d-ab1a-10fdcc5df5a7 tempest-SnapshotMetadataTestJSON-905060816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.eee78797-edcd-4ecc-931c-9ee7680390e1" returned: 0 in 0.528s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-67e9cc4c-678e-4a3d-ab1a-10fdcc5df5a7 tempest-SnapshotMetadataTestJSON-905060816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.eee78797-edcd-4ecc-931c-9ee7680390e1 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:35 devstack sudo[91851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.eee78797-edcd-4ecc-931c-9ee7680390e1 Sep 23 15:11:35 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:35 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-67e9cc4c-678e-4a3d-ab1a-10fdcc5df5a7 tempest-SnapshotMetadataTestJSON-905060816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf.eee78797-edcd-4ecc-931c-9ee7680390e1" returned: 0 in 0.313s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-67e9cc4c-678e-4a3d-ab1a-10fdcc5df5a7 tempest-SnapshotMetadataTestJSON-905060816 None] Lock "cinder-quobyte-eee78797-edcd-4ecc-931c-9ee7680390e1" released by "_delete_snapshot" :: held 2.500s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:11:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-67e9cc4c-678e-4a3d-ab1a-10fdcc5df5a7 tempest-SnapshotMetadataTestJSON-905060816 None] Lock "cinder-quobyte-78c0afbe-c99f-42c6-b969-92d68fb065bf" released by "delete_snapshot" :: held 2.545s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:11:35 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-67e9cc4c-678e-4a3d-ab1a-10fdcc5df5a7 tempest-SnapshotMetadataTestJSON-905060816 None] Created reservations ['94f55643-64fe-4215-8133-f3047bca1563', '5eea0727-7d87-42dc-b174-21753f046b10', 'dbfa7c6b-2950-499f-85e9-167d40c86565', 'fdd4be29-06a5-4e01-bf00-108657791072'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:11:35 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-67e9cc4c-678e-4a3d-ab1a-10fdcc5df5a7 tempest-SnapshotMetadataTestJSON-905060816 None] Delete snapshot completed successfully. Sep 23 15:11:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-67e9cc4c-678e-4a3d-ab1a-10fdcc5df5a7 tempest-SnapshotMetadataTestJSON-905060816 None] Lock "cinder-eee78797-edcd-4ecc-931c-9ee7680390e1-delete_snapshot" released by "delete_snapshot" :: held 2.764s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:11:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:11:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:11:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:11:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:11:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:11:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:11:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:36 devstack sudo[91861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:11:36 devstack sudo[91861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:36 devstack sudo[91861]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.348s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:11:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:11:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 8 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:11:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:11:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ce9904fb-8489-48ad-9f14-283923367ecb tempest-SnapshotMetadataTestJSON-905060816 None] Acquiring lock "cinder-78c0afbe-c99f-42c6-b969-92d68fb065bf-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:11:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ce9904fb-8489-48ad-9f14-283923367ecb tempest-SnapshotMetadataTestJSON-905060816 None] Lock "cinder-78c0afbe-c99f-42c6-b969-92d68fb065bf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:11:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ce9904fb-8489-48ad-9f14-283923367ecb tempest-SnapshotMetadataTestJSON-905060816 None] Acquiring lock "cinder-quobyte-78c0afbe-c99f-42c6-b969-92d68fb065bf" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:11:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ce9904fb-8489-48ad-9f14-283923367ecb tempest-SnapshotMetadataTestJSON-905060816 None] Lock "cinder-quobyte-78c0afbe-c99f-42c6-b969-92d68fb065bf" acquired by "delete_volume" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:11:36 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a3c54f-463a-4dad-90e8-1baf7bf59079]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:11:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ce9904fb-8489-48ad-9f14-283923367ecb tempest-SnapshotMetadataTestJSON-905060816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:36 devstack sudo[91864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf Sep 23 15:11:36 devstack sudo[91864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:37 devstack sudo[91864]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ce9904fb-8489-48ad-9f14-283923367ecb tempest-SnapshotMetadataTestJSON-905060816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf" returned: 0 in 0.540s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ce9904fb-8489-48ad-9f14-283923367ecb tempest-SnapshotMetadataTestJSON-905060816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:37 devstack sudo[91870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf Sep 23 15:11:37 devstack sudo[91870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:37 devstack sudo[91870]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ce9904fb-8489-48ad-9f14-283923367ecb tempest-SnapshotMetadataTestJSON-905060816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-78c0afbe-c99f-42c6-b969-92d68fb065bf" returned: 0 in 0.282s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ce9904fb-8489-48ad-9f14-283923367ecb tempest-SnapshotMetadataTestJSON-905060816 None] Lock "cinder-quobyte-78c0afbe-c99f-42c6-b969-92d68fb065bf" released by "delete_volume" :: held 0.928s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:11:37 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-ce9904fb-8489-48ad-9f14-283923367ecb tempest-SnapshotMetadataTestJSON-905060816 None] Created reservations ['eb867c49-f864-4e31-aaee-83add0443b77', '36f6c229-487f-43d8-b13e-ffcb6053e966', 'bb14c52a-b372-4d31-83a3-79ac747ae8e2', '8b49611f-3d8e-45ea-9e1a-e01086f2608f'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:11:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ce9904fb-8489-48ad-9f14-283923367ecb tempest-SnapshotMetadataTestJSON-905060816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:11:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ce9904fb-8489-48ad-9f14-283923367ecb tempest-SnapshotMetadataTestJSON-905060816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:11:37 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ce9904fb-8489-48ad-9f14-283923367ecb tempest-SnapshotMetadataTestJSON-905060816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:11:37 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ce9904fb-8489-48ad-9f14-283923367ecb tempest-SnapshotMetadataTestJSON-905060816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:11:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ce9904fb-8489-48ad-9f14-283923367ecb tempest-SnapshotMetadataTestJSON-905060816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:11:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ce9904fb-8489-48ad-9f14-283923367ecb tempest-SnapshotMetadataTestJSON-905060816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:37 devstack sudo[91873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:11:37 devstack sudo[91873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:38 devstack sudo[91873]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ce9904fb-8489-48ad-9f14-283923367ecb tempest-SnapshotMetadataTestJSON-905060816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.304s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:38 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-ce9904fb-8489-48ad-9f14-283923367ecb tempest-SnapshotMetadataTestJSON-905060816 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:11:38 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-ce9904fb-8489-48ad-9f14-283923367ecb tempest-SnapshotMetadataTestJSON-905060816 None] Deleted volume successfully. Sep 23 15:11:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ce9904fb-8489-48ad-9f14-283923367ecb tempest-SnapshotMetadataTestJSON-905060816 None] Lock "cinder-78c0afbe-c99f-42c6-b969-92d68fb065bf-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:11:40 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:11:40 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Flow 'volume_create_manager' (838b8b4b-062e-44a5-83ee-bfdb0f946b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:11:40 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2586218c-6977-4f98-9450-0cbbe5bcdebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:40 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2586218c-6977-4f98-9450-0cbbe5bcdebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1484920999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f0a6555-6de3-46d8-9e51-2c23f2523b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c406eeae31614e47aea5d660c8829efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:11:40Z,use_quota=True,user_id='0215d47d47a8458195470e86cade3124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:40 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65c1435-26ba-4499-b646-84448ec9154d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:40 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65c1435-26ba-4499-b646-84448ec9154d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:40 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f4d5f7-2119-424e-b212-8ba4d4f5e2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:40 devstack cinder-volume[86064]: DEBUG cinder.image.glance [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Creating Keystone auth plugin from conf {{(pid=86064) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 15:11:40 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f4d5f7-2119-424e-b212-8ba4d4f5e2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1f0a6555-6de3-46d8-9e51-2c23f2523b7e', 'volume_name': 'volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e', 'volume_size': 1, 'image_id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6096e44b8882450f8963b9e995032e95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'created_at': datetime.datetime(2026, 9, 23, 13, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e612db8e-4d33-469a-9b98-e7920f09b036/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:40 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94c22053-71ac-4113-9358-c301a5c0887d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:40 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94c22053-71ac-4113-9358-c301a5c0887d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:40 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd42b1a-eb97-4c4e-89ac-b17266d68061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:40 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Volume 1f0a6555-6de3-46d8-9e51-2c23f2523b7e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e', 'volume_size': 1, 'image_id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6096e44b8882450f8963b9e995032e95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'created_at': datetime.datetime(2026, 9, 23, 13, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e612db8e-4d33-469a-9b98-e7920f09b036/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 15:11:40 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Trying to clone 1f0a6555-6de3-46d8-9e51-2c23f2523b7e from image e612db8e-4d33-469a-9b98-e7920f09b036 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}]). {{(pid=86064) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 15:11:41 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_uz4o0ozkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 15:11:41 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Image download 20.69 MB at 20.69 MB/s Sep 23 15:11:41 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff203c7-629b-42df-8d89-8f6c94086f1e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:11:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_uz4o0ozkdevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:41 devstack sudo[91897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_uz4o0ozkdevstack@QuobyteHD Sep 23 15:11:41 devstack sudo[91897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:41 devstack sudo[91897]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_uz4o0ozkdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:41 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Temporary image e612db8e-4d33-469a-9b98-e7920f09b036 is fetched for user 0215d47d47a8458195470e86cade3124. {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 15:11:41 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c3f11e-b6a1-413e-847f-fdd4962fa754]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:11:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_uz4o0ozkdevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:42 devstack sudo[91902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_uz4o0ozkdevstack@QuobyteHD Sep 23 15:11:42 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:42 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_uz4o0ozkdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:11:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:11:42 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1484920999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f0a6555-6de3-46d8-9e51-2c23f2523b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c406eeae31614e47aea5d660c8829efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:11:40Z,use_quota=True,user_id='0215d47d47a8458195470e86cade3124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:11:42 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Creating volume 1f0a6555-6de3-46d8-9e51-2c23f2523b7e {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:11:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:11:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:11:42 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:11:42 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:11:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:11:42 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:11:42 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:11:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:42 devstack sudo[91907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e 1073741824 Sep 23 15:11:42 devstack sudo[91907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:42 devstack sudo[91907]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e 1073741824" returned: 0 in 0.506s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:42 devstack sudo[91914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e Sep 23 15:11:42 devstack sudo[91914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:43 devstack sudo[91914]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e" returned: 0 in 0.276s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:43 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:11:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:11:43 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Attempting download of e612db8e-4d33-469a-9b98-e7920f09b036 ((None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}])) to volume 1f0a6555-6de3-46d8-9e51-2c23f2523b7e. {{(pid=86064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 15:11:43 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3925afaa-d667-41c8-95f2-8f6b0e9c2e6f]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:11:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_58ok5yso {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:43 devstack sudo[91917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_58ok5yso Sep 23 15:11:43 devstack sudo[91917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:43 devstack sudo[91917]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_58ok5yso" returned: 0 in 0.371s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_58ok5yso {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:43 devstack sudo[91923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_58ok5yso Sep 23 15:11:43 devstack sudo[91923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:43 devstack sudo[91923]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_58ok5yso" returned: 1 in 0.371s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_58ok5yso' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:11:43 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4291c95-1183-42aa-b3ac-484ceacb48e8]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:11:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_uz4o0ozkdevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:44 devstack sudo[91927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_uz4o0ozkdevstack@QuobyteHD Sep 23 15:11:44 devstack sudo[91927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:44 devstack sudo[91927]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_uz4o0ozkdevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] e612db8e-4d33-469a-9b98-e7920f09b036 was qcow2, converting to qcow2 {{(pid=86064) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_uz4o0ozkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:44 devstack sudo[91932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_uz4o0ozkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e Sep 23 15:11:44 devstack sudo[91932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Flow 'volume_create_manager' (fe29d2ab-8452-491c-891b-ee1020ddff38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eabfb48-d21a-4e0f-9def-9e7950fafe03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eabfb48-d21a-4e0f-9def-9e7950fafe03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1022134801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e87fe86-402c-48e5-bc0e-d428ff579666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f34b7110daa042c78f84281da7b22323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:11:44Z,use_quota=True,user_id='3690243cf76a438db6e500e0b4e7b8e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a7ac962-f9ff-473a-8dc7-7895d128d7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a7ac962-f9ff-473a-8dc7-7895d128d7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad37f74f-f27e-439d-8ad3-621817d27d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad37f74f-f27e-439d-8ad3-621817d27d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e87fe86-402c-48e5-bc0e-d428ff579666', 'volume_name': 'volume-2e87fe86-402c-48e5-bc0e-d428ff579666', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66eee74d-0d62-4c45-9ed3-a61855e44774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66eee74d-0d62-4c45-9ed3-a61855e44774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338ae142-6a87-4717-abc0-b2ec94bb0cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:44 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Volume 2e87fe86-402c-48e5-bc0e-d428ff579666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e87fe86-402c-48e5-bc0e-d428ff579666', 'volume_size': 1} Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1022134801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e87fe86-402c-48e5-bc0e-d428ff579666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f34b7110daa042c78f84281da7b22323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:11:44Z,use_quota=True,user_id='3690243cf76a438db6e500e0b4e7b8e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Creating volume 2e87fe86-402c-48e5-bc0e-d428ff579666 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:11:44 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:11:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2e87fe86-402c-48e5-bc0e-d428ff579666 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:44 devstack sudo[91934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2e87fe86-402c-48e5-bc0e-d428ff579666 1073741824 Sep 23 15:11:44 devstack sudo[91934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:45 devstack sudo[91934]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2e87fe86-402c-48e5-bc0e-d428ff579666 1073741824" returned: 0 in 0.607s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2e87fe86-402c-48e5-bc0e-d428ff579666 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:11:45 devstack sudo[91947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2e87fe86-402c-48e5-bc0e-d428ff579666 Sep 23 15:11:45 devstack sudo[91947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Flow 'volume_create_manager' (817702dd-f77d-493a-b314-d3cc3579d71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ec72cf-2f80-49f5-b2ce-86175120bd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ec72cf-2f80-49f5-b2ce-86175120bd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1189317645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc4642f-1981-419b-8b6c-f8f5a5153007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f0bab1d38b4169a9b5134b17c7291a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:11:45Z,use_quota=True,user_id='49412736919c490aa2110f2fe2a37929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff85273-a85a-42c5-84d1-bbfb68e50f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff85273-a85a-42c5-84d1-bbfb68e50f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c42b8d0-9e3d-4555-818f-a70658692617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c42b8d0-9e3d-4555-818f-a70658692617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fc4642f-1981-419b-8b6c-f8f5a5153007', 'volume_name': 'volume-1fc4642f-1981-419b-8b6c-f8f5a5153007', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (556dc09b-6e1f-44b2-92f4-b74d038662e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (556dc09b-6e1f-44b2-92f4-b74d038662e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14259e8e-f69f-4f42-b5d8-01bdf49982c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:45 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Volume 1fc4642f-1981-419b-8b6c-f8f5a5153007: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fc4642f-1981-419b-8b6c-f8f5a5153007', 'volume_size': 1} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:11:45 devstack sudo[91947]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2e87fe86-402c-48e5-bc0e-d428ff579666" returned: 0 in 0.319s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.046s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1189317645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc4642f-1981-419b-8b6c-f8f5a5153007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f0bab1d38b4169a9b5134b17c7291a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:11:45Z,use_quota=True,user_id='49412736919c490aa2110f2fe2a37929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Creating volume 1fc4642f-1981-419b-8b6c-f8f5a5153007 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:11:45 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1fc4642f-1981-419b-8b6c-f8f5a5153007 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338ae142-6a87-4717-abc0-b2ec94bb0cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e87fe86-402c-48e5-bc0e-d428ff579666', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfaff63-042c-47cf-8bd9-3ff84afdd521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:45 devstack sudo[91950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1fc4642f-1981-419b-8b6c-f8f5a5153007 1073741824 Sep 23 15:11:45 devstack sudo[91950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:45 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Volume volume-2e87fe86-402c-48e5-bc0e-d428ff579666 (2e87fe86-402c-48e5-bc0e-d428ff579666): created successfully Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfaff63-042c-47cf-8bd9-3ff84afdd521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Flow 'volume_create_manager' (fe29d2ab-8452-491c-891b-ee1020ddff38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:11:45 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f01e2bf2-d0f6-4a9f-91d8-05633f089998 tempest-AttachVolumeNegativeTest-588753607 None] Created volume successfully. Sep 23 15:11:46 devstack sudo[91950]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1fc4642f-1981-419b-8b6c-f8f5a5153007 1073741824" returned: 0 in 0.567s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1fc4642f-1981-419b-8b6c-f8f5a5153007 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:46 devstack sudo[91956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1fc4642f-1981-419b-8b6c-f8f5a5153007 Sep 23 15:11:46 devstack sudo[91956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:46 devstack sudo[91956]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1fc4642f-1981-419b-8b6c-f8f5a5153007" returned: 0 in 0.268s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:11:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:11:46 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14259e8e-f69f-4f42-b5d8-01bdf49982c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fc4642f-1981-419b-8b6c-f8f5a5153007', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:46 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6823ea2-05d7-47eb-9a39-09fc0c70c209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:46 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Volume volume-1fc4642f-1981-419b-8b6c-f8f5a5153007 (1fc4642f-1981-419b-8b6c-f8f5a5153007): created successfully Sep 23 15:11:46 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6823ea2-05d7-47eb-9a39-09fc0c70c209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:46 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Flow 'volume_create_manager' (817702dd-f77d-493a-b314-d3cc3579d71c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:11:46 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-6754674d-788b-40ba-a6d5-a601085a762a tempest-VolumesTransfersV355Test-1751014721 None] Created volume successfully. Sep 23 15:11:46 devstack sudo[91932]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_uz4o0ozkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e" returned: 0 in 2.416s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:46 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_uz4o0ozkdevstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:11:46 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Converted 112.00 MB image at 46.31 MB/s Sep 23 15:11:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:46 devstack sudo[91963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e 1G Sep 23 15:11:46 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:47 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e 1G" returned: 0 in 0.450s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:47 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Downloaded image e612db8e-4d33-469a-9b98-e7920f09b036 ((None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}])) to volume 1f0a6555-6de3-46d8-9e51-2c23f2523b7e successfully. {{(pid=86064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 15:11:47 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Temporary image e612db8e-4d33-469a-9b98-e7920f09b036 for user 0215d47d47a8458195470e86cade3124 is deleted. {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 15:11:47 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Marking volume 1f0a6555-6de3-46d8-9e51-2c23f2523b7e as bootable. {{(pid=86064) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 15:11:47 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Copying metadata from image e612db8e-4d33-469a-9b98-e7920f09b036 to 1f0a6555-6de3-46d8-9e51-2c23f2523b7e. {{(pid=86064) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 15:11:47 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Creating volume glance metadata for volume 1f0a6555-6de3-46d8-9e51-2c23f2523b7e backed by image e612db8e-4d33-469a-9b98-e7920f09b036 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86064) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 15:11:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd42b1a-eb97-4c4e-89ac-b17266d68061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e', 'volume_size': 1, 'image_id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6096e44b8882450f8963b9e995032e95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'created_at': datetime.datetime(2026, 9, 23, 13, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e612db8e-4d33-469a-9b98-e7920f09b036/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfcb52f4-b5a9-4862-ade6-d5aa8e2b1b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:47 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Volume volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e (1f0a6555-6de3-46d8-9e51-2c23f2523b7e): created successfully Sep 23 15:11:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfcb52f4-b5a9-4862-ade6-d5aa8e2b1b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Flow 'volume_create_manager' (838b8b4b-062e-44a5-83ee-bfdb0f946b33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:11:47 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-98e9a8a4-d8bf-4faa-b31b-359b56eb5340 tempest-ServerActionsTestOtherA-977966886 None] Created volume successfully. Sep 23 15:11:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-08cea1c1-38d8-4eaf-a335-9176a0a67c24 req-314a5881-7d81-4484-9aa0-94f1c326e1cd tempest-AttachVolumeNegativeTest-588753607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:11:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-08cea1c1-38d8-4eaf-a335-9176a0a67c24 req-314a5881-7d81-4484-9aa0-94f1c326e1cd tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:11:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-08cea1c1-38d8-4eaf-a335-9176a0a67c24 req-314a5881-7d81-4484-9aa0-94f1c326e1cd tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:11:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-08cea1c1-38d8-4eaf-a335-9176a0a67c24 req-314a5881-7d81-4484-9aa0-94f1c326e1cd tempest-AttachVolumeNegativeTest-588753607 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-2e87fe86-402c-48e5-bc0e-d428ff579666', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e7a391a4-e858-4d1d-bd9e-f16fbec352af', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:11:47 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-08cea1c1-38d8-4eaf-a335-9176a0a67c24 req-314a5881-7d81-4484-9aa0-94f1c326e1cd tempest-AttachVolumeNegativeTest-588753607 None] attachment_update completed successfully. Sep 23 15:11:48 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-17078f74-ec2d-42be-82ae-7a248aef9866 tempest-VolumesTransfersV355Test-2103632334 None] Transfer volume completed successfully. Sep 23 15:11:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0ee776cd-0960-4f9e-825f-a431986698c1 tempest-VolumesTransfersV355Test-1389735393 None] Acquiring lock "cinder-1fc4642f-1981-419b-8b6c-f8f5a5153007-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:11:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0ee776cd-0960-4f9e-825f-a431986698c1 tempest-VolumesTransfersV355Test-1389735393 None] Lock "cinder-1fc4642f-1981-419b-8b6c-f8f5a5153007-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:11:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0ee776cd-0960-4f9e-825f-a431986698c1 tempest-VolumesTransfersV355Test-1389735393 None] Acquiring lock "cinder-quobyte-1fc4642f-1981-419b-8b6c-f8f5a5153007" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:11:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0ee776cd-0960-4f9e-825f-a431986698c1 tempest-VolumesTransfersV355Test-1389735393 None] Lock "cinder-quobyte-1fc4642f-1981-419b-8b6c-f8f5a5153007" acquired by "delete_volume" :: waited 0.030s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:11:49 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e52b37-861e-4882-8198-a2b545aed65a]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:11:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0ee776cd-0960-4f9e-825f-a431986698c1 tempest-VolumesTransfersV355Test-1389735393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1fc4642f-1981-419b-8b6c-f8f5a5153007 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:49 devstack sudo[92395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1fc4642f-1981-419b-8b6c-f8f5a5153007 Sep 23 15:11:49 devstack sudo[92395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:49 devstack sudo[92395]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0ee776cd-0960-4f9e-825f-a431986698c1 tempest-VolumesTransfersV355Test-1389735393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1fc4642f-1981-419b-8b6c-f8f5a5153007" returned: 0 in 0.499s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0ee776cd-0960-4f9e-825f-a431986698c1 tempest-VolumesTransfersV355Test-1389735393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1fc4642f-1981-419b-8b6c-f8f5a5153007 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:50 devstack sudo[92405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1fc4642f-1981-419b-8b6c-f8f5a5153007 Sep 23 15:11:50 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:50 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0ee776cd-0960-4f9e-825f-a431986698c1 tempest-VolumesTransfersV355Test-1389735393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1fc4642f-1981-419b-8b6c-f8f5a5153007" returned: 0 in 0.305s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:50 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0ee776cd-0960-4f9e-825f-a431986698c1 tempest-VolumesTransfersV355Test-1389735393 None] Lock "cinder-quobyte-1fc4642f-1981-419b-8b6c-f8f5a5153007" released by "delete_volume" :: held 0.888s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:11:50 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-0ee776cd-0960-4f9e-825f-a431986698c1 tempest-VolumesTransfersV355Test-1389735393 None] Created reservations ['b04cb1bf-0910-4be4-b572-b5c1fad2579a', '4c97be90-3d34-4274-8e0a-72b8a5ae6bbf', '5debc8d0-aa91-4288-9226-208c1214e027', '8091c391-4546-495c-b291-49380890751b'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:11:50 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-b9f4b5a9-bc00-40e3-a8ba-ef2ac56c43d3 req-7880e14d-0ca2-47e1-a31c-65c29ff31e53 tempest-AttachVolumeNegativeTest-588753607 None] Terminate volume connection completed successfully. Sep 23 15:11:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-b9f4b5a9-bc00-40e3-a8ba-ef2ac56c43d3 req-7880e14d-0ca2-47e1-a31c-65c29ff31e53 tempest-AttachVolumeNegativeTest-588753607 None] Deleting attachment e7a391a4-e858-4d1d-bd9e-f16fbec352af. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:11:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0ee776cd-0960-4f9e-825f-a431986698c1 tempest-VolumesTransfersV355Test-1389735393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:11:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0ee776cd-0960-4f9e-825f-a431986698c1 tempest-VolumesTransfersV355Test-1389735393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:11:50 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0ee776cd-0960-4f9e-825f-a431986698c1 tempest-VolumesTransfersV355Test-1389735393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:11:50 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0ee776cd-0960-4f9e-825f-a431986698c1 tempest-VolumesTransfersV355Test-1389735393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:11:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0ee776cd-0960-4f9e-825f-a431986698c1 tempest-VolumesTransfersV355Test-1389735393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:11:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0ee776cd-0960-4f9e-825f-a431986698c1 tempest-VolumesTransfersV355Test-1389735393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:50 devstack sudo[92434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:11:50 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:50 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0ee776cd-0960-4f9e-825f-a431986698c1 tempest-VolumesTransfersV355Test-1389735393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.311s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:50 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-0ee776cd-0960-4f9e-825f-a431986698c1 tempest-VolumesTransfersV355Test-1389735393 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:11:50 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-0ee776cd-0960-4f9e-825f-a431986698c1 tempest-VolumesTransfersV355Test-1389735393 None] Deleted volume successfully. Sep 23 15:11:50 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0ee776cd-0960-4f9e-825f-a431986698c1 tempest-VolumesTransfersV355Test-1389735393 None] Lock "cinder-1fc4642f-1981-419b-8b6c-f8f5a5153007-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:11:51 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:11:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Flow 'volume_create_manager' (6ddfd31b-a6bc-44bb-a967-b775555ad814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:11:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e472c014-6d98-42e5-a3e4-377ad8ceae91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e472c014-6d98-42e5-a3e4-377ad8ceae91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-14422990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95c7705-7425-479b-af1b-83665de8dcf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f0bab1d38b4169a9b5134b17c7291a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:11:51Z,use_quota=True,user_id='49412736919c490aa2110f2fe2a37929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c7a850-4d08-4239-9666-3c71525b224b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c7a850-4d08-4239-9666-3c71525b224b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe999c8-3756-4a70-aacb-f33319aab372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe999c8-3756-4a70-aacb-f33319aab372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c95c7705-7425-479b-af1b-83665de8dcf2', 'volume_name': 'volume-c95c7705-7425-479b-af1b-83665de8dcf2', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f135ffd0-5db9-4477-8b6a-9df7492946ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f135ffd0-5db9-4477-8b6a-9df7492946ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67befffe-1e0f-42f9-aa7b-0bcd1e32994a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:51 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Volume c95c7705-7425-479b-af1b-83665de8dcf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c95c7705-7425-479b-af1b-83665de8dcf2', 'volume_size': 1} Sep 23 15:11:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:11:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:11:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-14422990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95c7705-7425-479b-af1b-83665de8dcf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f0bab1d38b4169a9b5134b17c7291a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:11:51Z,use_quota=True,user_id='49412736919c490aa2110f2fe2a37929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:11:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Creating volume c95c7705-7425-479b-af1b-83665de8dcf2 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:11:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:11:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:11:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:11:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:11:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:11:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:11:51 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:11:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c95c7705-7425-479b-af1b-83665de8dcf2 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:51 devstack sudo[92438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c95c7705-7425-479b-af1b-83665de8dcf2 1073741824 Sep 23 15:11:51 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:52 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c95c7705-7425-479b-af1b-83665de8dcf2 1073741824" returned: 0 in 0.827s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c95c7705-7425-479b-af1b-83665de8dcf2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:52 devstack sudo[92472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c95c7705-7425-479b-af1b-83665de8dcf2 Sep 23 15:11:52 devstack sudo[92472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-a79cf260-017a-4cbc-8b72-338a419c2c77 req-96f19770-2d1e-4fd5-800c-a85f0c9b0950 tempest-ServerActionsTestOtherA-977966886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:11:52 devstack sudo[92472]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c95c7705-7425-479b-af1b-83665de8dcf2" returned: 0 in 0.314s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:11:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:11:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-a79cf260-017a-4cbc-8b72-338a419c2c77 req-96f19770-2d1e-4fd5-800c-a85f0c9b0950 tempest-ServerActionsTestOtherA-977966886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.260s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:11:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67befffe-1e0f-42f9-aa7b-0bcd1e32994a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c95c7705-7425-479b-af1b-83665de8dcf2', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb15576-1186-424b-a429-3d50269eadc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:11:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-a79cf260-017a-4cbc-8b72-338a419c2c77 req-96f19770-2d1e-4fd5-800c-a85f0c9b0950 tempest-ServerActionsTestOtherA-977966886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:11:52 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Volume volume-c95c7705-7425-479b-af1b-83665de8dcf2 (c95c7705-7425-479b-af1b-83665de8dcf2): created successfully Sep 23 15:11:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb15576-1186-424b-a429-3d50269eadc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:11:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Flow 'volume_create_manager' (6ddfd31b-a6bc-44bb-a967-b775555ad814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:11:52 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f99fd6aa-f609-4035-b709-729d6eb2e159 tempest-VolumesTransfersV355Test-1751014721 None] Created volume successfully. Sep 23 15:11:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-a79cf260-017a-4cbc-8b72-338a419c2c77 req-96f19770-2d1e-4fd5-800c-a85f0c9b0950 tempest-ServerActionsTestOtherA-977966886 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c23cc698-ba8f-4e19-9254-f23c0803a3a1', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:11:52 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-a79cf260-017a-4cbc-8b72-338a419c2c77 req-96f19770-2d1e-4fd5-800c-a85f0c9b0950 tempest-ServerActionsTestOtherA-977966886 None] attachment_update completed successfully. Sep 23 15:11:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5dffa62c-3026-4a92-b7dd-51e691298702 tempest-VolumesTransfersV355Test-1389735393 None] Acquiring lock "cinder-c95c7705-7425-479b-af1b-83665de8dcf2-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:11:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5dffa62c-3026-4a92-b7dd-51e691298702 tempest-VolumesTransfersV355Test-1389735393 None] Lock "cinder-c95c7705-7425-479b-af1b-83665de8dcf2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:11:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5dffa62c-3026-4a92-b7dd-51e691298702 tempest-VolumesTransfersV355Test-1389735393 None] Acquiring lock "cinder-quobyte-c95c7705-7425-479b-af1b-83665de8dcf2" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:11:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5dffa62c-3026-4a92-b7dd-51e691298702 tempest-VolumesTransfersV355Test-1389735393 None] Lock "cinder-quobyte-c95c7705-7425-479b-af1b-83665de8dcf2" acquired by "delete_volume" :: waited 0.028s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:11:53 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[2659a261-ec6a-4e67-9270-7e022496af52]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:11:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5dffa62c-3026-4a92-b7dd-51e691298702 tempest-VolumesTransfersV355Test-1389735393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c95c7705-7425-479b-af1b-83665de8dcf2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:54 devstack sudo[92478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c95c7705-7425-479b-af1b-83665de8dcf2 Sep 23 15:11:54 devstack sudo[92478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:54 devstack sudo[92478]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5dffa62c-3026-4a92-b7dd-51e691298702 tempest-VolumesTransfersV355Test-1389735393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c95c7705-7425-479b-af1b-83665de8dcf2" returned: 0 in 0.455s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5dffa62c-3026-4a92-b7dd-51e691298702 tempest-VolumesTransfersV355Test-1389735393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c95c7705-7425-479b-af1b-83665de8dcf2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:54 devstack sudo[92483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c95c7705-7425-479b-af1b-83665de8dcf2 Sep 23 15:11:54 devstack sudo[92483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:54 devstack sudo[92483]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5dffa62c-3026-4a92-b7dd-51e691298702 tempest-VolumesTransfersV355Test-1389735393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c95c7705-7425-479b-af1b-83665de8dcf2" returned: 0 in 0.375s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:54 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5dffa62c-3026-4a92-b7dd-51e691298702 tempest-VolumesTransfersV355Test-1389735393 None] Lock "cinder-quobyte-c95c7705-7425-479b-af1b-83665de8dcf2" released by "delete_volume" :: held 0.901s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:11:54 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-5dffa62c-3026-4a92-b7dd-51e691298702 tempest-VolumesTransfersV355Test-1389735393 None] Created reservations ['47de354c-50a8-4d8f-b4a0-3518cc3e84d4', 'f14732e7-cd0c-4c5e-adf4-2cfbd52f6a5a', '340cf654-096c-4ca1-a7e6-54631e4fe1d0', 'ebc91b82-3016-449b-a4b2-464172957f68'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:11:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5dffa62c-3026-4a92-b7dd-51e691298702 tempest-VolumesTransfersV355Test-1389735393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:11:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5dffa62c-3026-4a92-b7dd-51e691298702 tempest-VolumesTransfersV355Test-1389735393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:11:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5dffa62c-3026-4a92-b7dd-51e691298702 tempest-VolumesTransfersV355Test-1389735393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:11:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5dffa62c-3026-4a92-b7dd-51e691298702 tempest-VolumesTransfersV355Test-1389735393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:11:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5dffa62c-3026-4a92-b7dd-51e691298702 tempest-VolumesTransfersV355Test-1389735393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:11:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5dffa62c-3026-4a92-b7dd-51e691298702 tempest-VolumesTransfersV355Test-1389735393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:55 devstack sudo[92487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:11:55 devstack sudo[92487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:55 devstack sudo[92487]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5dffa62c-3026-4a92-b7dd-51e691298702 tempest-VolumesTransfersV355Test-1389735393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.341s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:55 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-5dffa62c-3026-4a92-b7dd-51e691298702 tempest-VolumesTransfersV355Test-1389735393 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:11:55 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5dffa62c-3026-4a92-b7dd-51e691298702 tempest-VolumesTransfersV355Test-1389735393 None] Deleted volume successfully. Sep 23 15:11:55 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5dffa62c-3026-4a92-b7dd-51e691298702 tempest-VolumesTransfersV355Test-1389735393 None] Lock "cinder-c95c7705-7425-479b-af1b-83665de8dcf2-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:11:57 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fd0d1ec9-362c-411f-8980-7724739c721c tempest-AttachVolumeNegativeTest-588753607 None] Acquiring lock "cinder-2e87fe86-402c-48e5-bc0e-d428ff579666-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:11:57 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fd0d1ec9-362c-411f-8980-7724739c721c tempest-AttachVolumeNegativeTest-588753607 None] Lock "cinder-2e87fe86-402c-48e5-bc0e-d428ff579666-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:11:57 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fd0d1ec9-362c-411f-8980-7724739c721c tempest-AttachVolumeNegativeTest-588753607 None] Acquiring lock "cinder-quobyte-2e87fe86-402c-48e5-bc0e-d428ff579666" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:11:57 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fd0d1ec9-362c-411f-8980-7724739c721c tempest-AttachVolumeNegativeTest-588753607 None] Lock "cinder-quobyte-2e87fe86-402c-48e5-bc0e-d428ff579666" acquired by "delete_volume" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:11:57 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c53bf6-db7e-4e75-b71b-60f7e110b3de]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:11:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fd0d1ec9-362c-411f-8980-7724739c721c tempest-AttachVolumeNegativeTest-588753607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2e87fe86-402c-48e5-bc0e-d428ff579666 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:57 devstack sudo[92926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2e87fe86-402c-48e5-bc0e-d428ff579666 Sep 23 15:11:57 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:57 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fd0d1ec9-362c-411f-8980-7724739c721c tempest-AttachVolumeNegativeTest-588753607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2e87fe86-402c-48e5-bc0e-d428ff579666" returned: 0 in 0.623s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fd0d1ec9-362c-411f-8980-7724739c721c tempest-AttachVolumeNegativeTest-588753607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2e87fe86-402c-48e5-bc0e-d428ff579666 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:58 devstack sudo[92946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2e87fe86-402c-48e5-bc0e-d428ff579666 Sep 23 15:11:58 devstack sudo[92946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:58 devstack sudo[92946]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fd0d1ec9-362c-411f-8980-7724739c721c tempest-AttachVolumeNegativeTest-588753607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2e87fe86-402c-48e5-bc0e-d428ff579666" returned: 0 in 0.490s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fd0d1ec9-362c-411f-8980-7724739c721c tempest-AttachVolumeNegativeTest-588753607 None] Lock "cinder-quobyte-2e87fe86-402c-48e5-bc0e-d428ff579666" released by "delete_volume" :: held 1.214s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:11:58 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-fd0d1ec9-362c-411f-8980-7724739c721c tempest-AttachVolumeNegativeTest-588753607 None] Created reservations ['cedb191a-60dd-48ea-8dd0-396d15161d01', '8b3cbf3a-56b5-4792-8f31-2d7e3444d5aa', '75bf2d91-b50e-4854-a30d-a33e03d48152', 'cc81f7ce-5b4b-4a53-9ca0-a688db01370f'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:11:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fd0d1ec9-362c-411f-8980-7724739c721c tempest-AttachVolumeNegativeTest-588753607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:11:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fd0d1ec9-362c-411f-8980-7724739c721c tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:11:58 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fd0d1ec9-362c-411f-8980-7724739c721c tempest-AttachVolumeNegativeTest-588753607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:11:58 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fd0d1ec9-362c-411f-8980-7724739c721c tempest-AttachVolumeNegativeTest-588753607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:11:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fd0d1ec9-362c-411f-8980-7724739c721c tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:11:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fd0d1ec9-362c-411f-8980-7724739c721c tempest-AttachVolumeNegativeTest-588753607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:11:58 devstack sudo[92950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:11:58 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:11:59 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root Sep 23 15:11:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fd0d1ec9-362c-411f-8980-7724739c721c tempest-AttachVolumeNegativeTest-588753607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.431s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:11:59 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fd0d1ec9-362c-411f-8980-7724739c721c tempest-AttachVolumeNegativeTest-588753607 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:11:59 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-fd0d1ec9-362c-411f-8980-7724739c721c tempest-AttachVolumeNegativeTest-588753607 None] Deleted volume successfully. Sep 23 15:11:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fd0d1ec9-362c-411f-8980-7724739c721c tempest-AttachVolumeNegativeTest-588753607 None] Lock "cinder-2e87fe86-402c-48e5-bc0e-d428ff579666-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:11:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0813a88e-6014-4058-b9c6-63601a5fcd5f tempest-AttachVolumeNegativeTest-588753607 None] Acquiring lock "cinder-b1fce8ba-eb5d-4312-a120-358958a2c49d-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:11:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0813a88e-6014-4058-b9c6-63601a5fcd5f tempest-AttachVolumeNegativeTest-588753607 None] Lock "cinder-b1fce8ba-eb5d-4312-a120-358958a2c49d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:11:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0813a88e-6014-4058-b9c6-63601a5fcd5f tempest-AttachVolumeNegativeTest-588753607 None] Acquiring lock "cinder-quobyte-b1fce8ba-eb5d-4312-a120-358958a2c49d" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:11:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0813a88e-6014-4058-b9c6-63601a5fcd5f tempest-AttachVolumeNegativeTest-588753607 None] Lock "cinder-quobyte-b1fce8ba-eb5d-4312-a120-358958a2c49d" acquired by "delete_volume" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:11:59 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b9a558-9187-4e62-b497-a7a798a1be94]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:11:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0813a88e-6014-4058-b9c6-63601a5fcd5f tempest-AttachVolumeNegativeTest-588753607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b1fce8ba-eb5d-4312-a120-358958a2c49d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:00 devstack sudo[92956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b1fce8ba-eb5d-4312-a120-358958a2c49d Sep 23 15:12:00 devstack sudo[92956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:00 devstack sudo[92956]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0813a88e-6014-4058-b9c6-63601a5fcd5f tempest-AttachVolumeNegativeTest-588753607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b1fce8ba-eb5d-4312-a120-358958a2c49d" returned: 0 in 0.444s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0813a88e-6014-4058-b9c6-63601a5fcd5f tempest-AttachVolumeNegativeTest-588753607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b1fce8ba-eb5d-4312-a120-358958a2c49d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:00 devstack sudo[92962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b1fce8ba-eb5d-4312-a120-358958a2c49d Sep 23 15:12:00 devstack sudo[92962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:00 devstack sudo[92962]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0813a88e-6014-4058-b9c6-63601a5fcd5f tempest-AttachVolumeNegativeTest-588753607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b1fce8ba-eb5d-4312-a120-358958a2c49d" returned: 0 in 0.436s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:00 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0813a88e-6014-4058-b9c6-63601a5fcd5f tempest-AttachVolumeNegativeTest-588753607 None] Lock "cinder-quobyte-b1fce8ba-eb5d-4312-a120-358958a2c49d" released by "delete_volume" :: held 0.969s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:12:00 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-0813a88e-6014-4058-b9c6-63601a5fcd5f tempest-AttachVolumeNegativeTest-588753607 None] Created reservations ['02ce73cd-6105-4c56-8913-59086d906e8a', '277de81c-6dfb-4bab-90d1-bee909f1d485', 'a4c4719d-de90-44be-84cd-3cb57e33c773', '237bd44e-fd8d-4611-bdac-d0d3d74dd23c'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:12:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0813a88e-6014-4058-b9c6-63601a5fcd5f tempest-AttachVolumeNegativeTest-588753607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0813a88e-6014-4058-b9c6-63601a5fcd5f tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0813a88e-6014-4058-b9c6-63601a5fcd5f tempest-AttachVolumeNegativeTest-588753607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:12:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0813a88e-6014-4058-b9c6-63601a5fcd5f tempest-AttachVolumeNegativeTest-588753607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:12:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0813a88e-6014-4058-b9c6-63601a5fcd5f tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0813a88e-6014-4058-b9c6-63601a5fcd5f tempest-AttachVolumeNegativeTest-588753607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:01 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:12:01 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:01 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0813a88e-6014-4058-b9c6-63601a5fcd5f tempest-AttachVolumeNegativeTest-588753607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.488s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:01 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-0813a88e-6014-4058-b9c6-63601a5fcd5f tempest-AttachVolumeNegativeTest-588753607 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:12:01 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-0813a88e-6014-4058-b9c6-63601a5fcd5f tempest-AttachVolumeNegativeTest-588753607 None] Deleted volume successfully. Sep 23 15:12:01 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0813a88e-6014-4058-b9c6-63601a5fcd5f tempest-AttachVolumeNegativeTest-588753607 None] Lock "cinder-b1fce8ba-eb5d-4312-a120-358958a2c49d-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:12:02 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bf6112a1-a190-4355-bd1f-e231efaef840 tempest-AttachVolumeNegativeTest-588753607 None] Acquiring lock "cinder-2c8405d0-74ea-411c-9e0c-a2e3707bafef-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:12:02 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bf6112a1-a190-4355-bd1f-e231efaef840 tempest-AttachVolumeNegativeTest-588753607 None] Lock "cinder-2c8405d0-74ea-411c-9e0c-a2e3707bafef-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:12:02 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bf6112a1-a190-4355-bd1f-e231efaef840 tempest-AttachVolumeNegativeTest-588753607 None] Acquiring lock "cinder-quobyte-2c8405d0-74ea-411c-9e0c-a2e3707bafef" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:12:02 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bf6112a1-a190-4355-bd1f-e231efaef840 tempest-AttachVolumeNegativeTest-588753607 None] Lock "cinder-quobyte-2c8405d0-74ea-411c-9e0c-a2e3707bafef" acquired by "delete_volume" :: waited 0.031s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:12:02 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[198608c6-04a3-4f6c-adb1-0d8fdb34d9f6]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:12:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bf6112a1-a190-4355-bd1f-e231efaef840 tempest-AttachVolumeNegativeTest-588753607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2c8405d0-74ea-411c-9e0c-a2e3707bafef {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:02 devstack sudo[92991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2c8405d0-74ea-411c-9e0c-a2e3707bafef Sep 23 15:12:02 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:03 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bf6112a1-a190-4355-bd1f-e231efaef840 tempest-AttachVolumeNegativeTest-588753607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2c8405d0-74ea-411c-9e0c-a2e3707bafef" returned: 0 in 0.804s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bf6112a1-a190-4355-bd1f-e231efaef840 tempest-AttachVolumeNegativeTest-588753607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2c8405d0-74ea-411c-9e0c-a2e3707bafef {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:03 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2c8405d0-74ea-411c-9e0c-a2e3707bafef Sep 23 15:12:03 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:04 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bf6112a1-a190-4355-bd1f-e231efaef840 tempest-AttachVolumeNegativeTest-588753607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2c8405d0-74ea-411c-9e0c-a2e3707bafef" returned: 0 in 0.679s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bf6112a1-a190-4355-bd1f-e231efaef840 tempest-AttachVolumeNegativeTest-588753607 None] Lock "cinder-quobyte-2c8405d0-74ea-411c-9e0c-a2e3707bafef" released by "delete_volume" :: held 1.587s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:12:04 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-bf6112a1-a190-4355-bd1f-e231efaef840 tempest-AttachVolumeNegativeTest-588753607 None] Created reservations ['f50af852-77ec-4016-885e-7bf751be2855', '52866747-b69d-476d-9338-7433da41d707', '90215af2-316b-47ec-9308-a64db7411231', '37ff8e1c-da25-4c1b-b95c-1722ddfb57cb'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:12:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bf6112a1-a190-4355-bd1f-e231efaef840 tempest-AttachVolumeNegativeTest-588753607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bf6112a1-a190-4355-bd1f-e231efaef840 tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bf6112a1-a190-4355-bd1f-e231efaef840 tempest-AttachVolumeNegativeTest-588753607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:12:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bf6112a1-a190-4355-bd1f-e231efaef840 tempest-AttachVolumeNegativeTest-588753607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:12:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bf6112a1-a190-4355-bd1f-e231efaef840 tempest-AttachVolumeNegativeTest-588753607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bf6112a1-a190-4355-bd1f-e231efaef840 tempest-AttachVolumeNegativeTest-588753607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:04 devstack sudo[93003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:12:04 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:04 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bf6112a1-a190-4355-bd1f-e231efaef840 tempest-AttachVolumeNegativeTest-588753607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.478s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:04 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-bf6112a1-a190-4355-bd1f-e231efaef840 tempest-AttachVolumeNegativeTest-588753607 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:12:04 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-bf6112a1-a190-4355-bd1f-e231efaef840 tempest-AttachVolumeNegativeTest-588753607 None] Deleted volume successfully. Sep 23 15:12:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bf6112a1-a190-4355-bd1f-e231efaef840 tempest-AttachVolumeNegativeTest-588753607 None] Lock "cinder-2c8405d0-74ea-411c-9e0c-a2e3707bafef-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:12:09 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-54284035-b9c7-4f32-a363-13e85d8de463 tempest-AttachVolumeShelveTestJSON-1747534317 None] Acquiring lock "cinder-9812c9fc-8d78-4213-8f31-f2563064916c-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:12:09 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-54284035-b9c7-4f32-a363-13e85d8de463 tempest-AttachVolumeShelveTestJSON-1747534317 None] Lock "cinder-9812c9fc-8d78-4213-8f31-f2563064916c-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:12:09 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-54284035-b9c7-4f32-a363-13e85d8de463 tempest-AttachVolumeShelveTestJSON-1747534317 None] Acquiring lock "cinder-quobyte-9812c9fc-8d78-4213-8f31-f2563064916c" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:12:09 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-54284035-b9c7-4f32-a363-13e85d8de463 tempest-AttachVolumeShelveTestJSON-1747534317 None] Lock "cinder-quobyte-9812c9fc-8d78-4213-8f31-f2563064916c" acquired by "delete_volume" :: waited 0.035s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:12:10 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5a1361-1442-4862-953a-e6184145f659]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:12:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-54284035-b9c7-4f32-a363-13e85d8de463 tempest-AttachVolumeShelveTestJSON-1747534317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9812c9fc-8d78-4213-8f31-f2563064916c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:10 devstack sudo[93026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9812c9fc-8d78-4213-8f31-f2563064916c Sep 23 15:12:10 devstack sudo[93026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:11 devstack sudo[93026]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-54284035-b9c7-4f32-a363-13e85d8de463 tempest-AttachVolumeShelveTestJSON-1747534317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9812c9fc-8d78-4213-8f31-f2563064916c" returned: 0 in 0.958s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-54284035-b9c7-4f32-a363-13e85d8de463 tempest-AttachVolumeShelveTestJSON-1747534317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9812c9fc-8d78-4213-8f31-f2563064916c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:11 devstack sudo[93046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9812c9fc-8d78-4213-8f31-f2563064916c Sep 23 15:12:11 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Flow 'volume_create_manager' (cbdf6b99-e6c7-4db0-b9a2-8c6d1b99d05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3a6e60-1dad-4b85-8806-3cf502481130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3a6e60-1dad-4b85-8806-3cf502481130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-650506027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f6b57c-c978-4b61-8504-94e13001515f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34f8143161f94972a5cfc14fbbfc6e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:12:11Z,use_quota=True,user_id='0ed9a37b65194fce876fbe4280946358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bf6b48-c77d-4d29-8890-8ee39f570ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bf6b48-c77d-4d29-8890-8ee39f570ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7aa990e-bf07-4337-853f-5aba2fbaf764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7aa990e-bf07-4337-853f-5aba2fbaf764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33f6b57c-c978-4b61-8504-94e13001515f', 'volume_name': 'volume-33f6b57c-c978-4b61-8504-94e13001515f', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01aa428c-65a8-40b2-9242-d97590774b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01aa428c-65a8-40b2-9242-d97590774b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce717dc-c8e6-4559-97ce-20ad3348a87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:11 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Volume 33f6b57c-c978-4b61-8504-94e13001515f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33f6b57c-c978-4b61-8504-94e13001515f', 'volume_size': 1} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-650506027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f6b57c-c978-4b61-8504-94e13001515f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34f8143161f94972a5cfc14fbbfc6e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:12:11Z,use_quota=True,user_id='0ed9a37b65194fce876fbe4280946358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Creating volume 33f6b57c-c978-4b61-8504-94e13001515f {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:12:11 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-33f6b57c-c978-4b61-8504-94e13001515f 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:11 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-33f6b57c-c978-4b61-8504-94e13001515f 1073741824 Sep 23 15:12:11 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:11 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-54284035-b9c7-4f32-a363-13e85d8de463 tempest-AttachVolumeShelveTestJSON-1747534317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9812c9fc-8d78-4213-8f31-f2563064916c" returned: 0 in 0.559s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-54284035-b9c7-4f32-a363-13e85d8de463 tempest-AttachVolumeShelveTestJSON-1747534317 None] Lock "cinder-quobyte-9812c9fc-8d78-4213-8f31-f2563064916c" released by "delete_volume" :: held 1.636s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:12:11 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-54284035-b9c7-4f32-a363-13e85d8de463 tempest-AttachVolumeShelveTestJSON-1747534317 None] Created reservations ['ca078bad-48a5-4ba9-ac9b-8e70b59b6a5d', 'a0b0a3b9-24cb-43bb-96ce-ca801e7ec2a9', '76ba5d85-46f6-4653-983a-ff33023bdbd1', '1ecaa022-354c-440d-900e-d7f66630ae6a'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:12:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-54284035-b9c7-4f32-a363-13e85d8de463 tempest-AttachVolumeShelveTestJSON-1747534317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-54284035-b9c7-4f32-a363-13e85d8de463 tempest-AttachVolumeShelveTestJSON-1747534317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-54284035-b9c7-4f32-a363-13e85d8de463 tempest-AttachVolumeShelveTestJSON-1747534317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:12:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-54284035-b9c7-4f32-a363-13e85d8de463 tempest-AttachVolumeShelveTestJSON-1747534317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:12:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-54284035-b9c7-4f32-a363-13e85d8de463 tempest-AttachVolumeShelveTestJSON-1747534317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-54284035-b9c7-4f32-a363-13e85d8de463 tempest-AttachVolumeShelveTestJSON-1747534317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:12 devstack sudo[93071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:12:12 devstack sudo[93071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:12 devstack sudo[93071]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-54284035-b9c7-4f32-a363-13e85d8de463 tempest-AttachVolumeShelveTestJSON-1747534317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.540s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:12 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-54284035-b9c7-4f32-a363-13e85d8de463 tempest-AttachVolumeShelveTestJSON-1747534317 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:12:12 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-54284035-b9c7-4f32-a363-13e85d8de463 tempest-AttachVolumeShelveTestJSON-1747534317 None] Deleted volume successfully. Sep 23 15:12:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-54284035-b9c7-4f32-a363-13e85d8de463 tempest-AttachVolumeShelveTestJSON-1747534317 None] Lock "cinder-9812c9fc-8d78-4213-8f31-f2563064916c-delete_volume" released by "delete_volume" :: held 2.789s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:12:12 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-33f6b57c-c978-4b61-8504-94e13001515f 1073741824" returned: 0 in 1.207s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-33f6b57c-c978-4b61-8504-94e13001515f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:12 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-33f6b57c-c978-4b61-8504-94e13001515f Sep 23 15:12:12 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:13 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-33f6b57c-c978-4b61-8504-94e13001515f" returned: 0 in 0.282s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:12:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce717dc-c8e6-4559-97ce-20ad3348a87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33f6b57c-c978-4b61-8504-94e13001515f', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a8929f1-0c5a-42c2-9791-506d87b2a18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:13 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Volume volume-33f6b57c-c978-4b61-8504-94e13001515f (33f6b57c-c978-4b61-8504-94e13001515f): created successfully Sep 23 15:12:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a8929f1-0c5a-42c2-9791-506d87b2a18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Flow 'volume_create_manager' (cbdf6b99-e6c7-4db0-b9a2-8c6d1b99d05f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:12:13 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-75735546-c328-4da2-9b5d-358113fdef64 tempest-VolumesTransfersV357Test-1238569199 None] Created volume successfully. Sep 23 15:12:15 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f01a6fd5-2c6e-4dd0-b9e8-bd0cf0aa8763 tempest-VolumesTransfersV357Test-1662344672 None] Transfer volume completed successfully. Sep 23 15:12:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fece3dec-0db6-4b12-982a-e5d3ed6b57ae tempest-VolumesTransfersV357Test-995678314 None] Acquiring lock "cinder-33f6b57c-c978-4b61-8504-94e13001515f-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:12:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fece3dec-0db6-4b12-982a-e5d3ed6b57ae tempest-VolumesTransfersV357Test-995678314 None] Lock "cinder-33f6b57c-c978-4b61-8504-94e13001515f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:12:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fece3dec-0db6-4b12-982a-e5d3ed6b57ae tempest-VolumesTransfersV357Test-995678314 None] Acquiring lock "cinder-quobyte-33f6b57c-c978-4b61-8504-94e13001515f" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:12:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fece3dec-0db6-4b12-982a-e5d3ed6b57ae tempest-VolumesTransfersV357Test-995678314 None] Lock "cinder-quobyte-33f6b57c-c978-4b61-8504-94e13001515f" acquired by "delete_volume" :: waited 0.028s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:12:16 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f14df6-c8f3-4d2b-8fba-5b0c08ad39f0]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:12:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fece3dec-0db6-4b12-982a-e5d3ed6b57ae tempest-VolumesTransfersV357Test-995678314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-33f6b57c-c978-4b61-8504-94e13001515f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:16 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-33f6b57c-c978-4b61-8504-94e13001515f Sep 23 15:12:16 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:16 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fece3dec-0db6-4b12-982a-e5d3ed6b57ae tempest-VolumesTransfersV357Test-995678314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-33f6b57c-c978-4b61-8504-94e13001515f" returned: 0 in 0.670s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fece3dec-0db6-4b12-982a-e5d3ed6b57ae tempest-VolumesTransfersV357Test-995678314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-33f6b57c-c978-4b61-8504-94e13001515f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:16 devstack sudo[93122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-33f6b57c-c978-4b61-8504-94e13001515f Sep 23 15:12:16 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:17 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fece3dec-0db6-4b12-982a-e5d3ed6b57ae tempest-VolumesTransfersV357Test-995678314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-33f6b57c-c978-4b61-8504-94e13001515f" returned: 0 in 0.343s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fece3dec-0db6-4b12-982a-e5d3ed6b57ae tempest-VolumesTransfersV357Test-995678314 None] Lock "cinder-quobyte-33f6b57c-c978-4b61-8504-94e13001515f" released by "delete_volume" :: held 1.086s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:12:17 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-fece3dec-0db6-4b12-982a-e5d3ed6b57ae tempest-VolumesTransfersV357Test-995678314 None] Created reservations ['ccf35506-d899-4291-9daa-a2f7109a883d', '35755e8b-1056-4e0e-b528-0b870e9e7e5a', '038d0e06-5593-403e-a25f-dedcca953dd8', '12baa6ef-e4a1-4218-b847-7fe74f83e031'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:12:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fece3dec-0db6-4b12-982a-e5d3ed6b57ae tempest-VolumesTransfersV357Test-995678314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fece3dec-0db6-4b12-982a-e5d3ed6b57ae tempest-VolumesTransfersV357Test-995678314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fece3dec-0db6-4b12-982a-e5d3ed6b57ae tempest-VolumesTransfersV357Test-995678314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:12:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fece3dec-0db6-4b12-982a-e5d3ed6b57ae tempest-VolumesTransfersV357Test-995678314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:12:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fece3dec-0db6-4b12-982a-e5d3ed6b57ae tempest-VolumesTransfersV357Test-995678314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fece3dec-0db6-4b12-982a-e5d3ed6b57ae tempest-VolumesTransfersV357Test-995678314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:17 devstack sudo[93126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:12:17 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:17 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fece3dec-0db6-4b12-982a-e5d3ed6b57ae tempest-VolumesTransfersV357Test-995678314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.493s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:17 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fece3dec-0db6-4b12-982a-e5d3ed6b57ae tempest-VolumesTransfersV357Test-995678314 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:12:17 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-fece3dec-0db6-4b12-982a-e5d3ed6b57ae tempest-VolumesTransfersV357Test-995678314 None] Deleted volume successfully. Sep 23 15:12:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fece3dec-0db6-4b12-982a-e5d3ed6b57ae tempest-VolumesTransfersV357Test-995678314 None] Lock "cinder-33f6b57c-c978-4b61-8504-94e13001515f-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:12:18 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-87b2fcb3-45d3-4157-9b57-cd8f34c4cb4b req-e1e61d25-7452-4bec-a307-b77dd176bc74 tempest-ServerActionsTestOtherA-977966886 None] Terminate volume connection completed successfully. Sep 23 15:12:18 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-87b2fcb3-45d3-4157-9b57-cd8f34c4cb4b req-e1e61d25-7452-4bec-a307-b77dd176bc74 tempest-ServerActionsTestOtherA-977966886 None] Deleting attachment c23cc698-ba8f-4e19-9254-f23c0803a3a1. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:12:19 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:12:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Flow 'volume_create_manager' (853dcd0b-ff9d-4303-815e-52affd9dba74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:12:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e92b5f8-2a32-4803-835a-efda230eecfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e92b5f8-2a32-4803-835a-efda230eecfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1095910519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e45c31c-26e5-4d54-975d-c3163209289c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34f8143161f94972a5cfc14fbbfc6e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:12:19Z,use_quota=True,user_id='0ed9a37b65194fce876fbe4280946358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8ed1cd-b7d7-4da4-a96f-8b9b38f8c2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8ed1cd-b7d7-4da4-a96f-8b9b38f8c2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47238214-9657-4df8-a96f-7cfbb9e7fcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47238214-9657-4df8-a96f-7cfbb9e7fcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e45c31c-26e5-4d54-975d-c3163209289c', 'volume_name': 'volume-1e45c31c-26e5-4d54-975d-c3163209289c', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc75546d-a78f-42d0-8c36-402164f001ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc75546d-a78f-42d0-8c36-402164f001ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab069d78-b94e-45d2-a48a-c5e6432b00ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:19 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Volume 1e45c31c-26e5-4d54-975d-c3163209289c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e45c31c-26e5-4d54-975d-c3163209289c', 'volume_size': 1} Sep 23 15:12:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1095910519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e45c31c-26e5-4d54-975d-c3163209289c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34f8143161f94972a5cfc14fbbfc6e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:12:19Z,use_quota=True,user_id='0ed9a37b65194fce876fbe4280946358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:12:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Creating volume 1e45c31c-26e5-4d54-975d-c3163209289c {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:12:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:12:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:12:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:12:19 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:12:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1e45c31c-26e5-4d54-975d-c3163209289c 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:19 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1e45c31c-26e5-4d54-975d-c3163209289c 1073741824 Sep 23 15:12:19 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:20 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1e45c31c-26e5-4d54-975d-c3163209289c 1073741824" returned: 0 in 0.655s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:20 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=86,cinder:UPDATE=90,cinder:INSERT=29,cinder:DELETE=4 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:12:20 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=91,cinder:UPDATE=100,cinder:INSERT=27,cinder:DELETE=11 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:12:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1e45c31c-26e5-4d54-975d-c3163209289c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:20 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1e45c31c-26e5-4d54-975d-c3163209289c Sep 23 15:12:20 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:20 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1e45c31c-26e5-4d54-975d-c3163209289c" returned: 0 in 0.498s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:12:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab069d78-b94e-45d2-a48a-c5e6432b00ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e45c31c-26e5-4d54-975d-c3163209289c', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd851e1b-b253-4b63-b3f1-b46a6b33cf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-87b2fcb3-45d3-4157-9b57-cd8f34c4cb4b req-ef7ad0b2-25f5-4dbb-8fdd-78b78aef611b tempest-ServerActionsTestOtherA-977966886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-87b2fcb3-45d3-4157-9b57-cd8f34c4cb4b req-ef7ad0b2-25f5-4dbb-8fdd-78b78aef611b tempest-ServerActionsTestOtherA-977966886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-87b2fcb3-45d3-4157-9b57-cd8f34c4cb4b req-ef7ad0b2-25f5-4dbb-8fdd-78b78aef611b tempest-ServerActionsTestOtherA-977966886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:20 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Volume volume-1e45c31c-26e5-4d54-975d-c3163209289c (1e45c31c-26e5-4d54-975d-c3163209289c): created successfully Sep 23 15:12:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd851e1b-b253-4b63-b3f1-b46a6b33cf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Flow 'volume_create_manager' (853dcd0b-ff9d-4303-815e-52affd9dba74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:12:20 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-b598ca6d-1f40-4e2a-bd78-522c091e52b8 tempest-VolumesTransfersV357Test-1238569199 None] Created volume successfully. Sep 23 15:12:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-87b2fcb3-45d3-4157-9b57-cd8f34c4cb4b req-ef7ad0b2-25f5-4dbb-8fdd-78b78aef611b tempest-ServerActionsTestOtherA-977966886 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8588c86c-e8a0-443a-ae61-94d6a3a03f1f', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:12:21 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-87b2fcb3-45d3-4157-9b57-cd8f34c4cb4b req-ef7ad0b2-25f5-4dbb-8fdd-78b78aef611b tempest-ServerActionsTestOtherA-977966886 None] attachment_update completed successfully. Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Flow 'volume_create_manager' (d8887531-90d5-40d1-9c32-9f171f7301e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da41ef7b-e664-4a8d-b2ac-6dfbf4db3645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da41ef7b-e664-4a8d-b2ac-6dfbf4db3645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1279790058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c0e389-378a-4fea-b0e6-8a45bd78a936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc37ec93105947448e2e5e52b26de249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:12:21Z,use_quota=True,user_id='113d594f896e4ce685706cd908af8e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af92eab6-9fcf-47c4-9225-e3d7d92d6abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af92eab6-9fcf-47c4-9225-e3d7d92d6abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fdbbfee-454d-43f9-9f4d-7498faf486e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fdbbfee-454d-43f9-9f4d-7498faf486e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11c0e389-378a-4fea-b0e6-8a45bd78a936', 'volume_name': 'volume-11c0e389-378a-4fea-b0e6-8a45bd78a936', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2969f045-6bfa-4a51-8af5-9e6ca629c36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2969f045-6bfa-4a51-8af5-9e6ca629c36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3da61c-7706-49c9-a0ce-988b8b5b02ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:21 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Volume 11c0e389-378a-4fea-b0e6-8a45bd78a936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11c0e389-378a-4fea-b0e6-8a45bd78a936', 'volume_size': 1} Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1279790058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c0e389-378a-4fea-b0e6-8a45bd78a936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc37ec93105947448e2e5e52b26de249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:12:21Z,use_quota=True,user_id='113d594f896e4ce685706cd908af8e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Creating volume 11c0e389-378a-4fea-b0e6-8a45bd78a936 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:12:21 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:21 devstack sudo[93170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936 1073741824 Sep 23 15:12:21 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1d1eb743-5ede-4983-8dba-e61ef87f37d5 tempest-VolumesTransfersV357Test-995678314 None] Acquiring lock "cinder-1e45c31c-26e5-4d54-975d-c3163209289c-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:12:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1d1eb743-5ede-4983-8dba-e61ef87f37d5 tempest-VolumesTransfersV357Test-995678314 None] Lock "cinder-1e45c31c-26e5-4d54-975d-c3163209289c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:12:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1d1eb743-5ede-4983-8dba-e61ef87f37d5 tempest-VolumesTransfersV357Test-995678314 None] Acquiring lock "cinder-quobyte-1e45c31c-26e5-4d54-975d-c3163209289c" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:12:22 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936 1073741824" returned: 0 in 0.890s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1d1eb743-5ede-4983-8dba-e61ef87f37d5 tempest-VolumesTransfersV357Test-995678314 None] Lock "cinder-quobyte-1e45c31c-26e5-4d54-975d-c3163209289c" acquired by "delete_volume" :: waited 0.042s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:12:22 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e469be34-99c7-40b4-9a28-ff09ab037862]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:12:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1d1eb743-5ede-4983-8dba-e61ef87f37d5 tempest-VolumesTransfersV357Test-995678314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1e45c31c-26e5-4d54-975d-c3163209289c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:22 devstack sudo[93613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936 Sep 23 15:12:22 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:22 devstack sudo[93608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1e45c31c-26e5-4d54-975d-c3163209289c Sep 23 15:12:22 devstack sudo[93608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:22 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936" returned: 0 in 0.446s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:12:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:22 devstack sudo[93608]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1d1eb743-5ede-4983-8dba-e61ef87f37d5 tempest-VolumesTransfersV357Test-995678314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1e45c31c-26e5-4d54-975d-c3163209289c" returned: 0 in 0.548s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1d1eb743-5ede-4983-8dba-e61ef87f37d5 tempest-VolumesTransfersV357Test-995678314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1e45c31c-26e5-4d54-975d-c3163209289c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:22 devstack sudo[93634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1e45c31c-26e5-4d54-975d-c3163209289c Sep 23 15:12:22 devstack sudo[93634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3da61c-7706-49c9-a0ce-988b8b5b02ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11c0e389-378a-4fea-b0e6-8a45bd78a936', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e9fe1b8-1ffd-4d86-96cb-1b2d864055f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:22 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Volume volume-11c0e389-378a-4fea-b0e6-8a45bd78a936 (11c0e389-378a-4fea-b0e6-8a45bd78a936): created successfully Sep 23 15:12:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e9fe1b8-1ffd-4d86-96cb-1b2d864055f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Flow 'volume_create_manager' (d8887531-90d5-40d1-9c32-9f171f7301e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:12:22 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-91b85be5-5b75-4215-8011-c0690329b4d0 req-83dcf711-1bcf-4b66-81d0-263c2958ede3 tempest-VolumesSnapshotsTestJSON-239705867 None] Created volume successfully. Sep 23 15:12:23 devstack sudo[93634]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1d1eb743-5ede-4983-8dba-e61ef87f37d5 tempest-VolumesTransfersV357Test-995678314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1e45c31c-26e5-4d54-975d-c3163209289c" returned: 0 in 0.350s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1d1eb743-5ede-4983-8dba-e61ef87f37d5 tempest-VolumesTransfersV357Test-995678314 None] Lock "cinder-quobyte-1e45c31c-26e5-4d54-975d-c3163209289c" released by "delete_volume" :: held 1.017s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:12:23 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-1d1eb743-5ede-4983-8dba-e61ef87f37d5 tempest-VolumesTransfersV357Test-995678314 None] Created reservations ['57a44bb0-a71d-422d-a886-58817c2dc2ea', '3a3e934c-612b-4f79-83e2-acb49d80515c', '42c88eb0-c6b8-4817-8f66-29335cc75096', '14d00e0a-718d-4080-a119-6a7792c6b710'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:12:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1d1eb743-5ede-4983-8dba-e61ef87f37d5 tempest-VolumesTransfersV357Test-995678314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1d1eb743-5ede-4983-8dba-e61ef87f37d5 tempest-VolumesTransfersV357Test-995678314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:23 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1d1eb743-5ede-4983-8dba-e61ef87f37d5 tempest-VolumesTransfersV357Test-995678314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:12:23 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1d1eb743-5ede-4983-8dba-e61ef87f37d5 tempest-VolumesTransfersV357Test-995678314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:12:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1d1eb743-5ede-4983-8dba-e61ef87f37d5 tempest-VolumesTransfersV357Test-995678314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1d1eb743-5ede-4983-8dba-e61ef87f37d5 tempest-VolumesTransfersV357Test-995678314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:23 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:12:23 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:23 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1d1eb743-5ede-4983-8dba-e61ef87f37d5 tempest-VolumesTransfersV357Test-995678314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.307s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:23 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-1d1eb743-5ede-4983-8dba-e61ef87f37d5 tempest-VolumesTransfersV357Test-995678314 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:12:23 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-1d1eb743-5ede-4983-8dba-e61ef87f37d5 tempest-VolumesTransfersV357Test-995678314 None] Deleted volume successfully. Sep 23 15:12:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1d1eb743-5ede-4983-8dba-e61ef87f37d5 tempest-VolumesTransfersV357Test-995678314 None] Lock "cinder-1e45c31c-26e5-4d54-975d-c3163209289c-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:12:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-d49e2b3f-7cb6-437f-a882-c5052ce988f6 req-564677a5-7332-4a67-8c21-18d6dd016f6c tempest-VolumesSnapshotsTestJSON-239705867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-d49e2b3f-7cb6-437f-a882-c5052ce988f6 req-564677a5-7332-4a67-8c21-18d6dd016f6c tempest-VolumesSnapshotsTestJSON-239705867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [req-d49e2b3f-7cb6-437f-a882-c5052ce988f6 req-564677a5-7332-4a67-8c21-18d6dd016f6c tempest-VolumesSnapshotsTestJSON-239705867 None] Creating offline snapshot 0f1c8048-813e-4721-af08-cc9e091ecd59 of volume 11c0e389-378a-4fea-b0e6-8a45bd78a936 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:12:24 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7f175a-8548-4886-b81f-a11967774353]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:12:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-d49e2b3f-7cb6-437f-a882-c5052ce988f6 req-564677a5-7332-4a67-8c21-18d6dd016f6c tempest-VolumesSnapshotsTestJSON-239705867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:24 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936 Sep 23 15:12:24 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:24 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-d49e2b3f-7cb6-437f-a882-c5052ce988f6 req-564677a5-7332-4a67-8c21-18d6dd016f6c tempest-VolumesSnapshotsTestJSON-239705867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936" returned: 0 in 0.575s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-d49e2b3f-7cb6-437f-a882-c5052ce988f6 req-564677a5-7332-4a67-8c21-18d6dd016f6c tempest-VolumesSnapshotsTestJSON-239705867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.0f1c8048-813e-4721-af08-cc9e091ecd59 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:24 devstack sudo[93655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.0f1c8048-813e-4721-af08-cc9e091ecd59 1G Sep 23 15:12:24 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:25 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-d49e2b3f-7cb6-437f-a882-c5052ce988f6 req-564677a5-7332-4a67-8c21-18d6dd016f6c tempest-VolumesSnapshotsTestJSON-239705867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.0f1c8048-813e-4721-af08-cc9e091ecd59 1G" returned: 0 in 0.653s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-d49e2b3f-7cb6-437f-a882-c5052ce988f6 req-564677a5-7332-4a67-8c21-18d6dd016f6c tempest-VolumesSnapshotsTestJSON-239705867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11c0e389-378a-4fea-b0e6-8a45bd78a936 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.0f1c8048-813e-4721-af08-cc9e091ecd59 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:25 devstack sudo[93661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11c0e389-378a-4fea-b0e6-8a45bd78a936 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.0f1c8048-813e-4721-af08-cc9e091ecd59 Sep 23 15:12:25 devstack sudo[93661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:25 devstack sudo[93661]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-d49e2b3f-7cb6-437f-a882-c5052ce988f6 req-564677a5-7332-4a67-8c21-18d6dd016f6c tempest-VolumesSnapshotsTestJSON-239705867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11c0e389-378a-4fea-b0e6-8a45bd78a936 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.0f1c8048-813e-4721-af08-cc9e091ecd59" returned: 0 in 0.626s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:25 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [req-d49e2b3f-7cb6-437f-a882-c5052ce988f6 req-564677a5-7332-4a67-8c21-18d6dd016f6c tempest-VolumesSnapshotsTestJSON-239705867 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.0f1c8048-813e-4721-af08-cc9e091ecd59 is being set with open permissions: ugo+rw Sep 23 15:12:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-d49e2b3f-7cb6-437f-a882-c5052ce988f6 req-564677a5-7332-4a67-8c21-18d6dd016f6c tempest-VolumesSnapshotsTestJSON-239705867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.0f1c8048-813e-4721-af08-cc9e091ecd59 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:26 devstack sudo[93668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.0f1c8048-813e-4721-af08-cc9e091ecd59 Sep 23 15:12:26 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:26 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-d49e2b3f-7cb6-437f-a882-c5052ce988f6 req-564677a5-7332-4a67-8c21-18d6dd016f6c tempest-VolumesSnapshotsTestJSON-239705867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.0f1c8048-813e-4721-af08-cc9e091ecd59" returned: 0 in 0.533s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-d49e2b3f-7cb6-437f-a882-c5052ce988f6 req-564677a5-7332-4a67-8c21-18d6dd016f6c tempest-VolumesSnapshotsTestJSON-239705867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:26 devstack sudo[93672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.info Sep 23 15:12:26 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:27 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-d49e2b3f-7cb6-437f-a882-c5052ce988f6 req-564677a5-7332-4a67-8c21-18d6dd016f6c tempest-VolumesSnapshotsTestJSON-239705867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.info" returned: 0 in 0.498s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:27 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [req-d49e2b3f-7cb6-437f-a882-c5052ce988f6 req-564677a5-7332-4a67-8c21-18d6dd016f6c tempest-VolumesSnapshotsTestJSON-239705867 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.info is being set with open permissions: ugo+rw Sep 23 15:12:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-d49e2b3f-7cb6-437f-a882-c5052ce988f6 req-564677a5-7332-4a67-8c21-18d6dd016f6c tempest-VolumesSnapshotsTestJSON-239705867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:27 devstack sudo[93675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.info Sep 23 15:12:27 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:27 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-d49e2b3f-7cb6-437f-a882-c5052ce988f6 req-564677a5-7332-4a67-8c21-18d6dd016f6c tempest-VolumesSnapshotsTestJSON-239705867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.info" returned: 0 in 0.482s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-d49e2b3f-7cb6-437f-a882-c5052ce988f6 req-564677a5-7332-4a67-8c21-18d6dd016f6c tempest-VolumesSnapshotsTestJSON-239705867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.634s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:27 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-d49e2b3f-7cb6-437f-a882-c5052ce988f6 req-564677a5-7332-4a67-8c21-18d6dd016f6c tempest-VolumesSnapshotsTestJSON-239705867 None] Create snapshot completed successfully Sep 23 15:12:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-bc155688-05ca-456b-9f3b-8e09557b39c9 req-0e68b243-f078-46db-b55c-5183cfa14156 tempest-VolumesSnapshotsTestJSON-239705867 None] Acquiring lock "cinder-0f1c8048-813e-4721-af08-cc9e091ecd59-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:12:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-bc155688-05ca-456b-9f3b-8e09557b39c9 req-0e68b243-f078-46db-b55c-5183cfa14156 tempest-VolumesSnapshotsTestJSON-239705867 None] Lock "cinder-0f1c8048-813e-4721-af08-cc9e091ecd59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:12:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-bc155688-05ca-456b-9f3b-8e09557b39c9 req-0e68b243-f078-46db-b55c-5183cfa14156 tempest-VolumesSnapshotsTestJSON-239705867 None] Acquiring lock "cinder-quobyte-11c0e389-378a-4fea-b0e6-8a45bd78a936" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:12:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-bc155688-05ca-456b-9f3b-8e09557b39c9 req-0e68b243-f078-46db-b55c-5183cfa14156 tempest-VolumesSnapshotsTestJSON-239705867 None] Lock "cinder-quobyte-11c0e389-378a-4fea-b0e6-8a45bd78a936" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:12:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-bc155688-05ca-456b-9f3b-8e09557b39c9 req-0e68b243-f078-46db-b55c-5183cfa14156 tempest-VolumesSnapshotsTestJSON-239705867 None] Acquiring lock "cinder-quobyte-0f1c8048-813e-4721-af08-cc9e091ecd59" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:12:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-bc155688-05ca-456b-9f3b-8e09557b39c9 req-0e68b243-f078-46db-b55c-5183cfa14156 tempest-VolumesSnapshotsTestJSON-239705867 None] Lock "cinder-quobyte-0f1c8048-813e-4721-af08-cc9e091ecd59" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:12:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [req-bc155688-05ca-456b-9f3b-8e09557b39c9 req-0e68b243-f078-46db-b55c-5183cfa14156 tempest-VolumesSnapshotsTestJSON-239705867 None] Deleting offline snapshot 0f1c8048-813e-4721-af08-cc9e091ecd59 of volume 11c0e389-378a-4fea-b0e6-8a45bd78a936 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:12:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [req-bc155688-05ca-456b-9f3b-8e09557b39c9 req-0e68b243-f078-46db-b55c-5183cfa14156 tempest-VolumesSnapshotsTestJSON-239705867 None] snapshot_file for this snap is: volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.0f1c8048-813e-4721-af08-cc9e091ecd59 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:12:28 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b309d1fc-b7c4-42e6-a276-6f9e15aa0c62]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:12:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-bc155688-05ca-456b-9f3b-8e09557b39c9 req-0e68b243-f078-46db-b55c-5183cfa14156 tempest-VolumesSnapshotsTestJSON-239705867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.0f1c8048-813e-4721-af08-cc9e091ecd59 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:28 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.0f1c8048-813e-4721-af08-cc9e091ecd59 Sep 23 15:12:28 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:29 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-bc155688-05ca-456b-9f3b-8e09557b39c9 req-0e68b243-f078-46db-b55c-5183cfa14156 tempest-VolumesSnapshotsTestJSON-239705867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.0f1c8048-813e-4721-af08-cc9e091ecd59" returned: 0 in 0.713s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [req-bc155688-05ca-456b-9f3b-8e09557b39c9 req-0e68b243-f078-46db-b55c-5183cfa14156 tempest-VolumesSnapshotsTestJSON-239705867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11c0e389-378a-4fea-b0e6-8a45bd78a936(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:12:29 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e184156-6c2f-49bf-b241-69d2eaeb6636]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:12:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-bc155688-05ca-456b-9f3b-8e09557b39c9 req-0e68b243-f078-46db-b55c-5183cfa14156 tempest-VolumesSnapshotsTestJSON-239705867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:29 devstack sudo[93683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936 Sep 23 15:12:29 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:30 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-bc155688-05ca-456b-9f3b-8e09557b39c9 req-0e68b243-f078-46db-b55c-5183cfa14156 tempest-VolumesSnapshotsTestJSON-239705867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936" returned: 0 in 0.706s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-bc155688-05ca-456b-9f3b-8e09557b39c9 req-0e68b243-f078-46db-b55c-5183cfa14156 tempest-VolumesSnapshotsTestJSON-239705867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.0f1c8048-813e-4721-af08-cc9e091ecd59 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:30 devstack sudo[93689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.0f1c8048-813e-4721-af08-cc9e091ecd59 Sep 23 15:12:30 devstack sudo[93689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:30 devstack sudo[93689]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-bc155688-05ca-456b-9f3b-8e09557b39c9 req-0e68b243-f078-46db-b55c-5183cfa14156 tempest-VolumesSnapshotsTestJSON-239705867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.0f1c8048-813e-4721-af08-cc9e091ecd59" returned: 0 in 0.728s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-bc155688-05ca-456b-9f3b-8e09557b39c9 req-0e68b243-f078-46db-b55c-5183cfa14156 tempest-VolumesSnapshotsTestJSON-239705867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.0f1c8048-813e-4721-af08-cc9e091ecd59 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:30 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.0f1c8048-813e-4721-af08-cc9e091ecd59 Sep 23 15:12:30 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:31 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-bc155688-05ca-456b-9f3b-8e09557b39c9 req-0e68b243-f078-46db-b55c-5183cfa14156 tempest-VolumesSnapshotsTestJSON-239705867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936.0f1c8048-813e-4721-af08-cc9e091ecd59" returned: 0 in 0.514s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-bc155688-05ca-456b-9f3b-8e09557b39c9 req-0e68b243-f078-46db-b55c-5183cfa14156 tempest-VolumesSnapshotsTestJSON-239705867 None] Lock "cinder-quobyte-0f1c8048-813e-4721-af08-cc9e091ecd59" released by "_delete_snapshot" :: held 2.874s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:12:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-bc155688-05ca-456b-9f3b-8e09557b39c9 req-0e68b243-f078-46db-b55c-5183cfa14156 tempest-VolumesSnapshotsTestJSON-239705867 None] Lock "cinder-quobyte-11c0e389-378a-4fea-b0e6-8a45bd78a936" released by "delete_snapshot" :: held 2.917s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:12:31 devstack cinder-volume[86064]: DEBUG cinder.quota [req-bc155688-05ca-456b-9f3b-8e09557b39c9 req-0e68b243-f078-46db-b55c-5183cfa14156 tempest-VolumesSnapshotsTestJSON-239705867 None] Created reservations ['30980624-f307-4ba6-b375-23abab5eb8d9', '18e0479f-2b86-4899-b8b4-b36e3df8b58c', 'fa64b311-2207-49a0-9202-28f1d63396c4', '52b59a1e-afe4-4c48-9632-ce0201ba013b'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:12:31 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-bc155688-05ca-456b-9f3b-8e09557b39c9 req-0e68b243-f078-46db-b55c-5183cfa14156 tempest-VolumesSnapshotsTestJSON-239705867 None] Delete snapshot completed successfully. Sep 23 15:12:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-bc155688-05ca-456b-9f3b-8e09557b39c9 req-0e68b243-f078-46db-b55c-5183cfa14156 tempest-VolumesSnapshotsTestJSON-239705867 None] Lock "cinder-0f1c8048-813e-4721-af08-cc9e091ecd59-delete_snapshot" released by "delete_snapshot" :: held 3.177s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:12:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-90012c53-56a7-4b70-903e-cf6761db96e3 req-40d346c4-6a65-4adb-b79f-6747b718636c tempest-VolumesSnapshotsTestJSON-239705867 None] Acquiring lock "cinder-11c0e389-378a-4fea-b0e6-8a45bd78a936-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:12:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-90012c53-56a7-4b70-903e-cf6761db96e3 req-40d346c4-6a65-4adb-b79f-6747b718636c tempest-VolumesSnapshotsTestJSON-239705867 None] Lock "cinder-11c0e389-378a-4fea-b0e6-8a45bd78a936-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:12:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-90012c53-56a7-4b70-903e-cf6761db96e3 req-40d346c4-6a65-4adb-b79f-6747b718636c tempest-VolumesSnapshotsTestJSON-239705867 None] Acquiring lock "cinder-quobyte-11c0e389-378a-4fea-b0e6-8a45bd78a936" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:12:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-90012c53-56a7-4b70-903e-cf6761db96e3 req-40d346c4-6a65-4adb-b79f-6747b718636c tempest-VolumesSnapshotsTestJSON-239705867 None] Lock "cinder-quobyte-11c0e389-378a-4fea-b0e6-8a45bd78a936" acquired by "delete_volume" :: waited 0.043s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:12:32 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a93078-4a4a-4d0a-bba5-1f0e8672828c]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:12:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-90012c53-56a7-4b70-903e-cf6761db96e3 req-40d346c4-6a65-4adb-b79f-6747b718636c tempest-VolumesSnapshotsTestJSON-239705867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:32 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936 Sep 23 15:12:32 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:32 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-90012c53-56a7-4b70-903e-cf6761db96e3 req-40d346c4-6a65-4adb-b79f-6747b718636c tempest-VolumesSnapshotsTestJSON-239705867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936" returned: 0 in 0.508s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-90012c53-56a7-4b70-903e-cf6761db96e3 req-40d346c4-6a65-4adb-b79f-6747b718636c tempest-VolumesSnapshotsTestJSON-239705867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:32 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936 Sep 23 15:12:32 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:33 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-90012c53-56a7-4b70-903e-cf6761db96e3 req-40d346c4-6a65-4adb-b79f-6747b718636c tempest-VolumesSnapshotsTestJSON-239705867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11c0e389-378a-4fea-b0e6-8a45bd78a936" returned: 0 in 0.410s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-90012c53-56a7-4b70-903e-cf6761db96e3 req-40d346c4-6a65-4adb-b79f-6747b718636c tempest-VolumesSnapshotsTestJSON-239705867 None] Lock "cinder-quobyte-11c0e389-378a-4fea-b0e6-8a45bd78a936" released by "delete_volume" :: held 1.051s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:12:33 devstack cinder-volume[86064]: DEBUG cinder.quota [req-90012c53-56a7-4b70-903e-cf6761db96e3 req-40d346c4-6a65-4adb-b79f-6747b718636c tempest-VolumesSnapshotsTestJSON-239705867 None] Created reservations ['b019e6e4-31ee-47d4-8783-ed06f8a5d862', '9b55daf2-72fe-471e-b36a-dff85e025c67', '65cde346-d7de-418a-9149-502bd07463dc', 'b76d1706-3b93-48f4-9faf-ab9a8b8db253'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:12:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-90012c53-56a7-4b70-903e-cf6761db96e3 req-40d346c4-6a65-4adb-b79f-6747b718636c tempest-VolumesSnapshotsTestJSON-239705867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-90012c53-56a7-4b70-903e-cf6761db96e3 req-40d346c4-6a65-4adb-b79f-6747b718636c tempest-VolumesSnapshotsTestJSON-239705867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [req-90012c53-56a7-4b70-903e-cf6761db96e3 req-40d346c4-6a65-4adb-b79f-6747b718636c tempest-VolumesSnapshotsTestJSON-239705867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:12:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [req-90012c53-56a7-4b70-903e-cf6761db96e3 req-40d346c4-6a65-4adb-b79f-6747b718636c tempest-VolumesSnapshotsTestJSON-239705867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:12:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-90012c53-56a7-4b70-903e-cf6761db96e3 req-40d346c4-6a65-4adb-b79f-6747b718636c tempest-VolumesSnapshotsTestJSON-239705867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-90012c53-56a7-4b70-903e-cf6761db96e3 req-40d346c4-6a65-4adb-b79f-6747b718636c tempest-VolumesSnapshotsTestJSON-239705867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:33 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:12:33 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:33 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-90012c53-56a7-4b70-903e-cf6761db96e3 req-40d346c4-6a65-4adb-b79f-6747b718636c tempest-VolumesSnapshotsTestJSON-239705867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.322s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:33 devstack cinder-volume[86064]: DEBUG cinder.manager [req-90012c53-56a7-4b70-903e-cf6761db96e3 req-40d346c4-6a65-4adb-b79f-6747b718636c tempest-VolumesSnapshotsTestJSON-239705867 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:12:33 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-90012c53-56a7-4b70-903e-cf6761db96e3 req-40d346c4-6a65-4adb-b79f-6747b718636c tempest-VolumesSnapshotsTestJSON-239705867 None] Deleted volume successfully. Sep 23 15:12:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-90012c53-56a7-4b70-903e-cf6761db96e3 req-40d346c4-6a65-4adb-b79f-6747b718636c tempest-VolumesSnapshotsTestJSON-239705867 None] Lock "cinder-11c0e389-378a-4fea-b0e6-8a45bd78a936-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:12:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:12:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:12:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:12:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:36 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:12:36 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:36 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.463s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:12:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:12:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 28 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:12:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:12:37 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:12:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Flow 'volume_create_manager' (9123c848-3525-4099-ab6e-c72be422e787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:12:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (391ac717-1d66-4a58-954c-ff5de44c8cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (391ac717-1d66-4a58-954c-ff5de44c8cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1311663479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a79a632eeb844c61ba97d33ad6503c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:12:38Z,use_quota=True,user_id='87f14e449d124a45a6b237fec740f77b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab406e11-2e4f-4c3f-ae0d-9ee594164f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab406e11-2e4f-4c3f-ae0d-9ee594164f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b86109c4-eb5b-41cd-b6ff-2ed597170a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:37 devstack cinder-volume[86064]: DEBUG cinder.image.glance [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Creating Keystone auth plugin from conf {{(pid=86064) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 15:12:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b86109c4-eb5b-41cd-b6ff-2ed597170a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b', 'volume_name': 'volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b', 'volume_size': 1, 'image_id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6096e44b8882450f8963b9e995032e95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'created_at': datetime.datetime(2026, 9, 23, 13, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e612db8e-4d33-469a-9b98-e7920f09b036/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fbb0ee5-3a75-4762-b681-a1b8b5bc702f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fbb0ee5-3a75-4762-b681-a1b8b5bc702f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bd6290e-3d6e-48f1-add4-776ca9c0454e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:38 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Volume 8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b', 'volume_size': 1, 'image_id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6096e44b8882450f8963b9e995032e95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'created_at': datetime.datetime(2026, 9, 23, 13, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e612db8e-4d33-469a-9b98-e7920f09b036/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 15:12:38 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Trying to clone 8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b from image e612db8e-4d33-469a-9b98-e7920f09b036 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}]). {{(pid=86064) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 15:12:38 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_i27ai7cadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 15:12:38 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Image download 20.69 MB at 20.69 MB/s Sep 23 15:12:38 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[1218a984-7dff-41b2-83cf-42680dc43aaf]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:12:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_i27ai7cadevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:39 devstack sudo[93715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_i27ai7cadevstack@QuobyteHD Sep 23 15:12:39 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:39 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_i27ai7cadevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:39 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Temporary image e612db8e-4d33-469a-9b98-e7920f09b036 is fetched for user 87f14e449d124a45a6b237fec740f77b. {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 15:12:39 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca8485d-03e1-491c-82e6-a85f4673f851]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:12:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_i27ai7cadevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:39 devstack sudo[93720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_i27ai7cadevstack@QuobyteHD Sep 23 15:12:39 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:39 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_i27ai7cadevstack@QuobyteHD" returned: 0 in 0.453s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1311663479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a79a632eeb844c61ba97d33ad6503c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:12:38Z,use_quota=True,user_id='87f14e449d124a45a6b237fec740f77b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:12:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Creating volume 8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:12:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:12:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:12:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:12:39 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:12:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:39 devstack sudo[93725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b 1073741824 Sep 23 15:12:39 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:40 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b 1073741824" returned: 0 in 0.617s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:40 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b Sep 23 15:12:40 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:41 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b" returned: 0 in 0.386s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:41 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:12:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:41 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Attempting download of e612db8e-4d33-469a-9b98-e7920f09b036 ((None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}])) to volume 8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b. {{(pid=86064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 15:12:41 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d225717-4cbb-400e-b958-f1a3d8c42892]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:12:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_32d79yh7 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:41 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_32d79yh7 Sep 23 15:12:41 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:41 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_32d79yh7" returned: 0 in 0.450s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_32d79yh7 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:41 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_32d79yh7 Sep 23 15:12:41 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:42 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_32d79yh7" returned: 1 in 0.457s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_32d79yh7' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbb7fb5-8feb-409a-88c5-152a216d4111]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_i27ai7cadevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:42 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_i27ai7cadevstack@QuobyteHD Sep 23 15:12:42 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:42 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_i27ai7cadevstack@QuobyteHD" returned: 0 in 0.534s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] e612db8e-4d33-469a-9b98-e7920f09b036 was qcow2, converting to qcow2 {{(pid=86064) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_i27ai7cadevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:42 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_i27ai7cadevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b Sep 23 15:12:42 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Flow 'volume_create_manager' (63a5c17d-0b08-4381-97fb-d930d3d8a044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d7c80d0-5a12-4241-bb46-72860221bc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d7c80d0-5a12-4241-bb46-72860221bc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-744938882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9263959c-6d04-4a8b-b474-8c101274c01d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4b13413b2bdd4fcfa7005cfaddcb1624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:12:43Z,use_quota=True,user_id='4099428a0a07411f81fda49895af4321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5a6e854-b4eb-46d7-bb26-2646f117b2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5a6e854-b4eb-46d7-bb26-2646f117b2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cef5802-8fc1-4781-bfaf-4584564f9389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cef5802-8fc1-4781-bfaf-4584564f9389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9263959c-6d04-4a8b-b474-8c101274c01d', 'volume_name': 'volume-9263959c-6d04-4a8b-b474-8c101274c01d', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153de4db-b013-49c4-9fee-268fca787546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153de4db-b013-49c4-9fee-268fca787546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3d7df5-2e6a-44e5-99c6-b6d15e060c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:42 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Volume 9263959c-6d04-4a8b-b474-8c101274c01d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9263959c-6d04-4a8b-b474-8c101274c01d', 'volume_size': 1} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-744938882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9263959c-6d04-4a8b-b474-8c101274c01d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4b13413b2bdd4fcfa7005cfaddcb1624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:12:43Z,use_quota=True,user_id='4099428a0a07411f81fda49895af4321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Creating volume 9263959c-6d04-4a8b-b474-8c101274c01d {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:12:42 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:12:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9263959c-6d04-4a8b-b474-8c101274c01d 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:42 devstack sudo[93819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9263959c-6d04-4a8b-b474-8c101274c01d 1073741824 Sep 23 15:12:42 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:43 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9263959c-6d04-4a8b-b474-8c101274c01d 1073741824" returned: 0 in 0.532s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9263959c-6d04-4a8b-b474-8c101274c01d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:43 devstack sudo[93830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9263959c-6d04-4a8b-b474-8c101274c01d Sep 23 15:12:43 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:43 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9263959c-6d04-4a8b-b474-8c101274c01d" returned: 0 in 0.366s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:43 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:12:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:43 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3d7df5-2e6a-44e5-99c6-b6d15e060c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9263959c-6d04-4a8b-b474-8c101274c01d', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:43 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d056cb-e243-4676-847c-0a23eb58bfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:43 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Volume volume-9263959c-6d04-4a8b-b474-8c101274c01d (9263959c-6d04-4a8b-b474-8c101274c01d): created successfully Sep 23 15:12:43 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d056cb-e243-4676-847c-0a23eb58bfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:43 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Flow 'volume_create_manager' (63a5c17d-0b08-4381-97fb-d930d3d8a044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:12:43 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-54dec9fb-82bb-4ccd-b18c-1c433c49df6e req-b7a9dfb5-6069-4eeb-81f3-bfe80087b3a2 tempest-VolumesGetTestJSON-530002261 None] Created volume successfully. Sep 23 15:12:44 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_i27ai7cadevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b" returned: 0 in 2.219s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:44 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_i27ai7cadevstack@QuobyteHD, size 112.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:12:44 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Converted 112.00 MB image at 50.45 MB/s Sep 23 15:12:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:44 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b 1G Sep 23 15:12:44 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-ceea50bc-8df6-4c88-b47c-9b0c090cb399 req-01dcbeb8-79c1-43d4-b713-7839548e1c38 tempest-VolumesGetTestJSON-530002261 None] Acquiring lock "cinder-9263959c-6d04-4a8b-b474-8c101274c01d-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:12:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-ceea50bc-8df6-4c88-b47c-9b0c090cb399 req-01dcbeb8-79c1-43d4-b713-7839548e1c38 tempest-VolumesGetTestJSON-530002261 None] Lock "cinder-9263959c-6d04-4a8b-b474-8c101274c01d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:12:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-ceea50bc-8df6-4c88-b47c-9b0c090cb399 req-01dcbeb8-79c1-43d4-b713-7839548e1c38 tempest-VolumesGetTestJSON-530002261 None] Acquiring lock "cinder-quobyte-9263959c-6d04-4a8b-b474-8c101274c01d" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:12:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-ceea50bc-8df6-4c88-b47c-9b0c090cb399 req-01dcbeb8-79c1-43d4-b713-7839548e1c38 tempest-VolumesGetTestJSON-530002261 None] Lock "cinder-quobyte-9263959c-6d04-4a8b-b474-8c101274c01d" acquired by "delete_volume" :: waited 0.024s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:12:45 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b 1G" returned: 0 in 0.480s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:45 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Downloaded image e612db8e-4d33-469a-9b98-e7920f09b036 ((None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}])) to volume 8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b successfully. {{(pid=86064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 15:12:45 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Temporary image e612db8e-4d33-469a-9b98-e7920f09b036 for user 87f14e449d124a45a6b237fec740f77b is deleted. {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 15:12:45 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Marking volume 8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b as bootable. {{(pid=86064) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 15:12:45 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[794ec313-6c16-4ae0-a5f0-2ce7d0b861d0]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:12:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-ceea50bc-8df6-4c88-b47c-9b0c090cb399 req-01dcbeb8-79c1-43d4-b713-7839548e1c38 tempest-VolumesGetTestJSON-530002261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9263959c-6d04-4a8b-b474-8c101274c01d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:45 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Copying metadata from image e612db8e-4d33-469a-9b98-e7920f09b036 to 8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b. {{(pid=86064) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 15:12:45 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Creating volume glance metadata for volume 8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b backed by image e612db8e-4d33-469a-9b98-e7920f09b036 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86064) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 15:12:45 devstack sudo[93843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9263959c-6d04-4a8b-b474-8c101274c01d Sep 23 15:12:45 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bd6290e-3d6e-48f1-add4-776ca9c0454e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b', 'volume_size': 1, 'image_id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6096e44b8882450f8963b9e995032e95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'created_at': datetime.datetime(2026, 9, 23, 13, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e612db8e-4d33-469a-9b98-e7920f09b036/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e000a9e9-c53b-4e69-9ca6-32c0916f0d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:45 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Volume volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b (8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b): created successfully Sep 23 15:12:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e000a9e9-c53b-4e69-9ca6-32c0916f0d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Flow 'volume_create_manager' (9123c848-3525-4099-ab6e-c72be422e787) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:12:45 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5177dee1-f7f4-4d13-8861-95dc0d0d9902 tempest-VolumesExtendTest-727381181 None] Created volume successfully. Sep 23 15:12:45 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-ceea50bc-8df6-4c88-b47c-9b0c090cb399 req-01dcbeb8-79c1-43d4-b713-7839548e1c38 tempest-VolumesGetTestJSON-530002261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9263959c-6d04-4a8b-b474-8c101274c01d" returned: 0 in 0.439s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-ceea50bc-8df6-4c88-b47c-9b0c090cb399 req-01dcbeb8-79c1-43d4-b713-7839548e1c38 tempest-VolumesGetTestJSON-530002261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9263959c-6d04-4a8b-b474-8c101274c01d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:45 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9263959c-6d04-4a8b-b474-8c101274c01d Sep 23 15:12:45 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:46 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-ceea50bc-8df6-4c88-b47c-9b0c090cb399 req-01dcbeb8-79c1-43d4-b713-7839548e1c38 tempest-VolumesGetTestJSON-530002261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9263959c-6d04-4a8b-b474-8c101274c01d" returned: 0 in 0.370s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-ceea50bc-8df6-4c88-b47c-9b0c090cb399 req-01dcbeb8-79c1-43d4-b713-7839548e1c38 tempest-VolumesGetTestJSON-530002261 None] Lock "cinder-quobyte-9263959c-6d04-4a8b-b474-8c101274c01d" released by "delete_volume" :: held 0.894s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:12:46 devstack cinder-volume[86064]: DEBUG cinder.quota [req-ceea50bc-8df6-4c88-b47c-9b0c090cb399 req-01dcbeb8-79c1-43d4-b713-7839548e1c38 tempest-VolumesGetTestJSON-530002261 None] Created reservations ['735f8daa-4b78-44f4-8c05-97c085db365c', 'a8fe5944-feb8-4035-be20-b6671b7c1f32', 'db578abb-21eb-4729-84c4-6e0e32b0f0d0', '1a32025f-b548-4c2f-9dd4-c01eae083049'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:12:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-ceea50bc-8df6-4c88-b47c-9b0c090cb399 req-01dcbeb8-79c1-43d4-b713-7839548e1c38 tempest-VolumesGetTestJSON-530002261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-ceea50bc-8df6-4c88-b47c-9b0c090cb399 req-01dcbeb8-79c1-43d4-b713-7839548e1c38 tempest-VolumesGetTestJSON-530002261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [req-ceea50bc-8df6-4c88-b47c-9b0c090cb399 req-01dcbeb8-79c1-43d4-b713-7839548e1c38 tempest-VolumesGetTestJSON-530002261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:12:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [req-ceea50bc-8df6-4c88-b47c-9b0c090cb399 req-01dcbeb8-79c1-43d4-b713-7839548e1c38 tempest-VolumesGetTestJSON-530002261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:12:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-ceea50bc-8df6-4c88-b47c-9b0c090cb399 req-01dcbeb8-79c1-43d4-b713-7839548e1c38 tempest-VolumesGetTestJSON-530002261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-ceea50bc-8df6-4c88-b47c-9b0c090cb399 req-01dcbeb8-79c1-43d4-b713-7839548e1c38 tempest-VolumesGetTestJSON-530002261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:46 devstack sudo[93868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:12:46 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f2f9cbff-b1ff-43f1-bb1b-9eb545997860 tempest-VolumesExtendTest-727381181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f2f9cbff-b1ff-43f1-bb1b-9eb545997860 tempest-VolumesExtendTest-727381181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:46 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4ac4a7-e756-4923-90d3-c16d6f14d87e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:12:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f2f9cbff-b1ff-43f1-bb1b-9eb545997860 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:46 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-ceea50bc-8df6-4c88-b47c-9b0c090cb399 req-01dcbeb8-79c1-43d4-b713-7839548e1c38 tempest-VolumesGetTestJSON-530002261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.334s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:46 devstack cinder-volume[86064]: DEBUG cinder.manager [req-ceea50bc-8df6-4c88-b47c-9b0c090cb399 req-01dcbeb8-79c1-43d4-b713-7839548e1c38 tempest-VolumesGetTestJSON-530002261 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:12:46 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-ceea50bc-8df6-4c88-b47c-9b0c090cb399 req-01dcbeb8-79c1-43d4-b713-7839548e1c38 tempest-VolumesGetTestJSON-530002261 None] Deleted volume successfully. Sep 23 15:12:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-ceea50bc-8df6-4c88-b47c-9b0c090cb399 req-01dcbeb8-79c1-43d4-b713-7839548e1c38 tempest-VolumesGetTestJSON-530002261 None] Lock "cinder-9263959c-6d04-4a8b-b474-8c101274c01d-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:12:46 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b Sep 23 15:12:46 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:47 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f2f9cbff-b1ff-43f1-bb1b-9eb545997860 tempest-VolumesExtendTest-727381181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b" returned: 0 in 0.486s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f2f9cbff-b1ff-43f1-bb1b-9eb545997860 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b 2G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f2f9cbff-b1ff-43f1-bb1b-9eb545997860 tempest-VolumesExtendTest-727381181 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b 2G" returned: 0 in 0.139s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f2f9cbff-b1ff-43f1-bb1b-9eb545997860 tempest-VolumesExtendTest-727381181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.667s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:47 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f2f9cbff-b1ff-43f1-bb1b-9eb545997860 tempest-VolumesExtendTest-727381181 None] Extend volume completed successfully. Sep 23 15:12:48 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-16e8f98c-c895-4cad-840d-d21e0b1efcb3 tempest-VolumesExtendTest-727381181 None] Acquiring lock "cinder-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:12:48 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-16e8f98c-c895-4cad-840d-d21e0b1efcb3 tempest-VolumesExtendTest-727381181 None] Lock "cinder-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:12:48 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-16e8f98c-c895-4cad-840d-d21e0b1efcb3 tempest-VolumesExtendTest-727381181 None] Acquiring lock "cinder-quobyte-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:12:48 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-16e8f98c-c895-4cad-840d-d21e0b1efcb3 tempest-VolumesExtendTest-727381181 None] Lock "cinder-quobyte-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b" acquired by "delete_volume" :: waited 0.015s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:12:48 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2a47b7-0651-45be-9a68-4076056d7dfe]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:12:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-16e8f98c-c895-4cad-840d-d21e0b1efcb3 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:48 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b Sep 23 15:12:48 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:49 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-16e8f98c-c895-4cad-840d-d21e0b1efcb3 tempest-VolumesExtendTest-727381181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b" returned: 0 in 0.979s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-16e8f98c-c895-4cad-840d-d21e0b1efcb3 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:49 devstack sudo[93943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b Sep 23 15:12:49 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:49 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-16e8f98c-c895-4cad-840d-d21e0b1efcb3 tempest-VolumesExtendTest-727381181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b" returned: 0 in 0.530s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-16e8f98c-c895-4cad-840d-d21e0b1efcb3 tempest-VolumesExtendTest-727381181 None] Lock "cinder-quobyte-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b" released by "delete_volume" :: held 1.579s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:12:49 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-16e8f98c-c895-4cad-840d-d21e0b1efcb3 tempest-VolumesExtendTest-727381181 None] Created reservations ['11aabd67-c580-4415-8b05-8fab8803f259', '0f37c2fa-be79-4302-9986-2f7f85e36d52', 'e0eeaa46-1ec5-4d11-a8f6-7ffce46e6e03', '796e59d9-41bb-483d-9468-6be4549bc965'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:12:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-16e8f98c-c895-4cad-840d-d21e0b1efcb3 tempest-VolumesExtendTest-727381181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-16e8f98c-c895-4cad-840d-d21e0b1efcb3 tempest-VolumesExtendTest-727381181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:50 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-16e8f98c-c895-4cad-840d-d21e0b1efcb3 tempest-VolumesExtendTest-727381181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:12:50 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-16e8f98c-c895-4cad-840d-d21e0b1efcb3 tempest-VolumesExtendTest-727381181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:12:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-16e8f98c-c895-4cad-840d-d21e0b1efcb3 tempest-VolumesExtendTest-727381181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-16e8f98c-c895-4cad-840d-d21e0b1efcb3 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:50 devstack sudo[93956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:12:50 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:50 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-16e8f98c-c895-4cad-840d-d21e0b1efcb3 tempest-VolumesExtendTest-727381181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.300s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:50 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-16e8f98c-c895-4cad-840d-d21e0b1efcb3 tempest-VolumesExtendTest-727381181 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:12:50 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-16e8f98c-c895-4cad-840d-d21e0b1efcb3 tempest-VolumesExtendTest-727381181 None] Deleted volume successfully. Sep 23 15:12:50 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-16e8f98c-c895-4cad-840d-d21e0b1efcb3 tempest-VolumesExtendTest-727381181 None] Lock "cinder-8d4883a5-0fe4-45c7-a5e2-b6c2fcdaf91b-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:12:51 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:12:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Flow 'volume_create_manager' (ac2e6f12-01ec-4ba4-b64d-bfcd20f606b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:12:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (850b460d-f78f-4185-bf67-99334238a497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (850b460d-f78f-4185-bf67-99334238a497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2108250445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a79a632eeb844c61ba97d33ad6503c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:12:52Z,use_quota=True,user_id='87f14e449d124a45a6b237fec740f77b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2864945f-bd15-426c-97de-d91fdd0d79ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2864945f-bd15-426c-97de-d91fdd0d79ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b49961b6-0221-4007-92d8-4c094e77aa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b49961b6-0221-4007-92d8-4c094e77aa03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25', 'volume_name': 'volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb3bd5b-152f-457b-98cd-b413fa63e62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb3bd5b-152f-457b-98cd-b413fa63e62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a12861-63c0-418f-a8dd-091b37396afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:51 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Volume d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25', 'volume_size': 1} Sep 23 15:12:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2108250445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a79a632eeb844c61ba97d33ad6503c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:12:52Z,use_quota=True,user_id='87f14e449d124a45a6b237fec740f77b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:12:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Creating volume d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:12:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:12:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:12:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:12:51 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:12:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:51 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25 1073741824 Sep 23 15:12:51 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:52 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25 1073741824" returned: 0 in 0.645s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:52 devstack sudo[93967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25 Sep 23 15:12:52 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:52 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25" returned: 0 in 0.371s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:12:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a12861-63c0-418f-a8dd-091b37396afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385a7ed8-eeb5-4291-bae6-bc3a6b3f5621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:52 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Volume volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25 (d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25): created successfully Sep 23 15:12:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385a7ed8-eeb5-4291-bae6-bc3a6b3f5621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Flow 'volume_create_manager' (ac2e6f12-01ec-4ba4-b64d-bfcd20f606b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:12:52 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-71702f26-01fc-41b4-b689-356135c7b9b6 tempest-VolumesExtendTest-727381181 None] Created volume successfully. Sep 23 15:12:53 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-48a3184e-2397-412c-bcb7-a2c5dfaa8610 tempest-GroupSnapshotsTest-23436513 None] Group tempest-GroupSnapshotsTest-Group-1590671208: creating Sep 23 15:12:53 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-48a3184e-2397-412c-bcb7-a2c5dfaa8610 tempest-GroupSnapshotsTest-23436513 None] Group tempest-GroupSnapshotsTest-Group-1590671208: created successfully Sep 23 15:12:53 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-48a3184e-2397-412c-bcb7-a2c5dfaa8610 tempest-GroupSnapshotsTest-23436513 None] Create group completed successfully. Sep 23 15:12:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8a67791a-9981-4c3d-bcf2-3e6ef7a9a4f9 tempest-VolumesExtendTest-727381181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8a67791a-9981-4c3d-bcf2-3e6ef7a9a4f9 tempest-VolumesExtendTest-727381181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-8a67791a-9981-4c3d-bcf2-3e6ef7a9a4f9 tempest-VolumesExtendTest-727381181 None] Creating offline snapshot 02108f14-072f-489f-95b6-4b8abed45633 of volume d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:12:54 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[454f8200-f1dd-41f4-b229-b431442fe233]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:12:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8a67791a-9981-4c3d-bcf2-3e6ef7a9a4f9 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:54 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25 Sep 23 15:12:54 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:55 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8a67791a-9981-4c3d-bcf2-3e6ef7a9a4f9 tempest-VolumesExtendTest-727381181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25" returned: 0 in 0.928s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8a67791a-9981-4c3d-bcf2-3e6ef7a9a4f9 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.02108f14-072f-489f-95b6-4b8abed45633 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:55 devstack sudo[94002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.02108f14-072f-489f-95b6-4b8abed45633 1G Sep 23 15:12:55 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:55 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:12:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Flow 'volume_create_manager' (fa1a2869-3485-4e7c-81ce-e6a666215184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:12:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd9454a-c24c-4fa0-857b-a771a90b48fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd9454a-c24c-4fa0-857b-a771a90b48fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-946556945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e83d26ee-f8a8-4c67-8bec-bafba8a1a851,host='devstack@QuobyteHD#QuobyteHD',id=46887b9c-1433-4d72-bfe3-2ad38957472d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6417a03110574e56904e3066416b5cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:12:56Z,use_quota=True,user_id='155b99cd87234e69a375688e5fef68a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2da437e-5e78-425c-9f13-b7d65872a5a2),volume_type_id=e2da437e-5e78-425c-9f13-b7d65872a5a2)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74164e1-402e-41dc-b734-cf7ecd732f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74164e1-402e-41dc-b734-cf7ecd732f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b516f12c-cc2f-4616-908e-c47673cd9b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b516f12c-cc2f-4616-908e-c47673cd9b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46887b9c-1433-4d72-bfe3-2ad38957472d', 'volume_name': 'volume-46887b9c-1433-4d72-bfe3-2ad38957472d', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ac7dde-87bc-420c-8cdb-8227d4876fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ac7dde-87bc-420c-8cdb-8227d4876fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79113f46-2ce6-4afc-92fb-4beb9c3f8717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:56 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Volume 46887b9c-1433-4d72-bfe3-2ad38957472d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46887b9c-1433-4d72-bfe3-2ad38957472d', 'volume_size': 1} Sep 23 15:12:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:56 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8a67791a-9981-4c3d-bcf2-3e6ef7a9a4f9 tempest-VolumesExtendTest-727381181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.02108f14-072f-489f-95b6-4b8abed45633 1G" returned: 0 in 0.764s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8a67791a-9981-4c3d-bcf2-3e6ef7a9a4f9 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.02108f14-072f-489f-95b6-4b8abed45633 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:56 devstack sudo[94011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.02108f14-072f-489f-95b6-4b8abed45633 Sep 23 15:12:56 devstack sudo[94011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:56 devstack sudo[94011]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8a67791a-9981-4c3d-bcf2-3e6ef7a9a4f9 tempest-VolumesExtendTest-727381181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.02108f14-072f-489f-95b6-4b8abed45633" returned: 0 in 0.492s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:56 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-8a67791a-9981-4c3d-bcf2-3e6ef7a9a4f9 tempest-VolumesExtendTest-727381181 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.02108f14-072f-489f-95b6-4b8abed45633 is being set with open permissions: ugo+rw Sep 23 15:12:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8a67791a-9981-4c3d-bcf2-3e6ef7a9a4f9 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.02108f14-072f-489f-95b6-4b8abed45633 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:56 devstack sudo[94017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.02108f14-072f-489f-95b6-4b8abed45633 Sep 23 15:12:56 devstack sudo[94017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:57 devstack sudo[94017]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8a67791a-9981-4c3d-bcf2-3e6ef7a9a4f9 tempest-VolumesExtendTest-727381181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.02108f14-072f-489f-95b6-4b8abed45633" returned: 0 in 0.533s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:57 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-c0e16e07-4b79-4d9e-aba1-48534a9934f6 req-fe67a587-ebee-4706-b3ce-78e7401b7def tempest-ServerActionsTestOtherA-977966886 None] Terminate volume connection completed successfully. Sep 23 15:12:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-c0e16e07-4b79-4d9e-aba1-48534a9934f6 req-fe67a587-ebee-4706-b3ce-78e7401b7def tempest-ServerActionsTestOtherA-977966886 None] Deleting attachment 8588c86c-e8a0-443a-ae61-94d6a3a03f1f. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:12:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8a67791a-9981-4c3d-bcf2-3e6ef7a9a4f9 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:57 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.info Sep 23 15:12:57 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:57 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-c0e16e07-4b79-4d9e-aba1-48534a9934f6 req-ae8e43dc-0e1b-4289-89ee-eec846900c2c tempest-ServerActionsTestOtherA-977966886 None] Acquiring lock "cinder-1f0a6555-6de3-46d8-9e51-2c23f2523b7e-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:12:57 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-c0e16e07-4b79-4d9e-aba1-48534a9934f6 req-ae8e43dc-0e1b-4289-89ee-eec846900c2c tempest-ServerActionsTestOtherA-977966886 None] Lock "cinder-1f0a6555-6de3-46d8-9e51-2c23f2523b7e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:12:57 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-c0e16e07-4b79-4d9e-aba1-48534a9934f6 req-ae8e43dc-0e1b-4289-89ee-eec846900c2c tempest-ServerActionsTestOtherA-977966886 None] Acquiring lock "cinder-quobyte-1f0a6555-6de3-46d8-9e51-2c23f2523b7e" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:12:57 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-c0e16e07-4b79-4d9e-aba1-48534a9934f6 req-ae8e43dc-0e1b-4289-89ee-eec846900c2c tempest-ServerActionsTestOtherA-977966886 None] Lock "cinder-quobyte-1f0a6555-6de3-46d8-9e51-2c23f2523b7e" acquired by "delete_volume" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:12:57 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb735757-0d01-42f8-a304-df38b90b0304]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:12:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-c0e16e07-4b79-4d9e-aba1-48534a9934f6 req-ae8e43dc-0e1b-4289-89ee-eec846900c2c tempest-ServerActionsTestOtherA-977966886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:57 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8a67791a-9981-4c3d-bcf2-3e6ef7a9a4f9 tempest-VolumesExtendTest-727381181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.info" returned: 0 in 0.372s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:57 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-8a67791a-9981-4c3d-bcf2-3e6ef7a9a4f9 tempest-VolumesExtendTest-727381181 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.info is being set with open permissions: ugo+rw Sep 23 15:12:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8a67791a-9981-4c3d-bcf2-3e6ef7a9a4f9 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:57 devstack sudo[94027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.info Sep 23 15:12:57 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:57 devstack sudo[94026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e Sep 23 15:12:57 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:58 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8a67791a-9981-4c3d-bcf2-3e6ef7a9a4f9 tempest-VolumesExtendTest-727381181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.info" returned: 0 in 0.399s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8a67791a-9981-4c3d-bcf2-3e6ef7a9a4f9 tempest-VolumesExtendTest-727381181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.736s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e83d26ee-f8a8-4c67-8bec-bafba8a1a851,created_at=2026-09-23T13:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-946556945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e83d26ee-f8a8-4c67-8bec-bafba8a1a851,host='devstack@QuobyteHD#QuobyteHD',id=46887b9c-1433-4d72-bfe3-2ad38957472d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6417a03110574e56904e3066416b5cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:12:56Z,use_quota=True,user_id='155b99cd87234e69a375688e5fef68a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2da437e-5e78-425c-9f13-b7d65872a5a2),volume_type_id=e2da437e-5e78-425c-9f13-b7d65872a5a2)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Creating volume 46887b9c-1433-4d72-bfe3-2ad38957472d {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:12:58 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:58 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-8a67791a-9981-4c3d-bcf2-3e6ef7a9a4f9 tempest-VolumesExtendTest-727381181 None] Create snapshot completed successfully Sep 23 15:12:58 devstack sudo[94034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d 1073741824 Sep 23 15:12:58 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-45df6e30-3f8f-4163-9503-8dd8bb72f33d tempest-ServerActionsTestOtherA-977966886 None] Acquiring lock "cinder-fb778eb5-ab01-4cc7-9290-9db864c337ed-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:12:58 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-c0e16e07-4b79-4d9e-aba1-48534a9934f6 req-ae8e43dc-0e1b-4289-89ee-eec846900c2c tempest-ServerActionsTestOtherA-977966886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e" returned: 0 in 0.573s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-c0e16e07-4b79-4d9e-aba1-48534a9934f6 req-ae8e43dc-0e1b-4289-89ee-eec846900c2c tempest-ServerActionsTestOtherA-977966886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-45df6e30-3f8f-4163-9503-8dd8bb72f33d tempest-ServerActionsTestOtherA-977966886 None] Lock "cinder-fb778eb5-ab01-4cc7-9290-9db864c337ed-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:12:58 devstack sudo[94036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e Sep 23 15:12:58 devstack sudo[94036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-45df6e30-3f8f-4163-9503-8dd8bb72f33d tempest-ServerActionsTestOtherA-977966886 None] Acquiring lock "cinder-quobyte-fb778eb5-ab01-4cc7-9290-9db864c337ed" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-45df6e30-3f8f-4163-9503-8dd8bb72f33d tempest-ServerActionsTestOtherA-977966886 None] Lock "cinder-quobyte-fb778eb5-ab01-4cc7-9290-9db864c337ed" acquired by "delete_volume" :: waited 0.024s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9aa2aed-6213-43ac-8c1b-0e5dbe40f8ef]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-45df6e30-3f8f-4163-9503-8dd8bb72f33d tempest-ServerActionsTestOtherA-977966886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb778eb5-ab01-4cc7-9290-9db864c337ed {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:58 devstack sudo[94038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb778eb5-ab01-4cc7-9290-9db864c337ed Sep 23 15:12:58 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:58 devstack sudo[94036]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-c0e16e07-4b79-4d9e-aba1-48534a9934f6 req-ae8e43dc-0e1b-4289-89ee-eec846900c2c tempest-ServerActionsTestOtherA-977966886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1f0a6555-6de3-46d8-9e51-2c23f2523b7e" returned: 0 in 0.554s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-c0e16e07-4b79-4d9e-aba1-48534a9934f6 req-ae8e43dc-0e1b-4289-89ee-eec846900c2c tempest-ServerActionsTestOtherA-977966886 None] Lock "cinder-quobyte-1f0a6555-6de3-46d8-9e51-2c23f2523b7e" released by "delete_volume" :: held 1.196s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ab86e960-dba2-4b6e-ae18-2384e7a33752 tempest-VolumesExtendTest-727381181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG cinder.quota [req-c0e16e07-4b79-4d9e-aba1-48534a9934f6 req-ae8e43dc-0e1b-4289-89ee-eec846900c2c tempest-ServerActionsTestOtherA-977966886 None] Created reservations ['ba3f19e7-99ad-4e57-926a-45d646d73033', 'e2c59234-134c-452d-92f0-db087d2aa908', '3fb1b853-242c-4c4a-a3cd-b327ff245668', 'f19946fc-cb01-453e-b4a5-2305a0c02894'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:12:58 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d 1073741824" returned: 0 in 0.812s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:58 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-45df6e30-3f8f-4163-9503-8dd8bb72f33d tempest-ServerActionsTestOtherA-977966886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb778eb5-ab01-4cc7-9290-9db864c337ed" returned: 0 in 0.665s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-45df6e30-3f8f-4163-9503-8dd8bb72f33d tempest-ServerActionsTestOtherA-977966886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb778eb5-ab01-4cc7-9290-9db864c337ed {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:58 devstack sudo[94048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d Sep 23 15:12:58 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:59 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb778eb5-ab01-4cc7-9290-9db864c337ed Sep 23 15:12:59 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-c0e16e07-4b79-4d9e-aba1-48534a9934f6 req-ae8e43dc-0e1b-4289-89ee-eec846900c2c tempest-ServerActionsTestOtherA-977966886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-c0e16e07-4b79-4d9e-aba1-48534a9934f6 req-ae8e43dc-0e1b-4289-89ee-eec846900c2c tempest-ServerActionsTestOtherA-977966886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [req-c0e16e07-4b79-4d9e-aba1-48534a9934f6 req-ae8e43dc-0e1b-4289-89ee-eec846900c2c tempest-ServerActionsTestOtherA-977966886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [req-c0e16e07-4b79-4d9e-aba1-48534a9934f6 req-ae8e43dc-0e1b-4289-89ee-eec846900c2c tempest-ServerActionsTestOtherA-977966886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-c0e16e07-4b79-4d9e-aba1-48534a9934f6 req-ae8e43dc-0e1b-4289-89ee-eec846900c2c tempest-ServerActionsTestOtherA-977966886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-c0e16e07-4b79-4d9e-aba1-48534a9934f6 req-ae8e43dc-0e1b-4289-89ee-eec846900c2c tempest-ServerActionsTestOtherA-977966886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:59 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:12:59 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:59 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d" returned: 0 in 0.277s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ab86e960-dba2-4b6e-ae18-2384e7a33752 tempest-VolumesExtendTest-727381181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.465s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79113f46-2ce6-4afc-92fb-4beb9c3f8717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46887b9c-1433-4d72-bfe3-2ad38957472d', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5128076a-c558-419c-a0ee-479400ca9581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8b145b-4878-45a6-99f6-6037f05ccf94]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ab86e960-dba2-4b6e-ae18-2384e7a33752 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:59 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-45df6e30-3f8f-4163-9503-8dd8bb72f33d tempest-ServerActionsTestOtherA-977966886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb778eb5-ab01-4cc7-9290-9db864c337ed" returned: 0 in 0.356s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:59 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Volume volume-46887b9c-1433-4d72-bfe3-2ad38957472d (46887b9c-1433-4d72-bfe3-2ad38957472d): created successfully Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5128076a-c558-419c-a0ee-479400ca9581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Flow 'volume_create_manager' (fa1a2869-3485-4e7c-81ce-e6a666215184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-45df6e30-3f8f-4163-9503-8dd8bb72f33d tempest-ServerActionsTestOtherA-977966886 None] Lock "cinder-quobyte-fb778eb5-ab01-4cc7-9290-9db864c337ed" released by "delete_volume" :: held 1.102s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:12:59 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-1f73a779-40be-42cc-bf68-3b084a34b2a6 tempest-GroupSnapshotsTest-23436513 None] Created volume successfully. Sep 23 15:12:59 devstack sudo[94056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25 Sep 23 15:12:59 devstack sudo[94056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-45df6e30-3f8f-4163-9503-8dd8bb72f33d tempest-ServerActionsTestOtherA-977966886 None] Created reservations ['6c2efab4-f505-4de6-ba04-4b3c5e85dae3', '73482e19-4d2a-4fb7-9ca2-20dab1661c2b', '66f14ce7-3211-4c1a-9da3-fece268f55ac', 'c16f59ba-a02b-4fd8-8efc-e8dc110fb3c7'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:12:59 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-c0e16e07-4b79-4d9e-aba1-48534a9934f6 req-ae8e43dc-0e1b-4289-89ee-eec846900c2c tempest-ServerActionsTestOtherA-977966886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.478s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG cinder.manager [req-c0e16e07-4b79-4d9e-aba1-48534a9934f6 req-ae8e43dc-0e1b-4289-89ee-eec846900c2c tempest-ServerActionsTestOtherA-977966886 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:12:59 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-c0e16e07-4b79-4d9e-aba1-48534a9934f6 req-ae8e43dc-0e1b-4289-89ee-eec846900c2c tempest-ServerActionsTestOtherA-977966886 None] Deleted volume successfully. Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-c0e16e07-4b79-4d9e-aba1-48534a9934f6 req-ae8e43dc-0e1b-4289-89ee-eec846900c2c tempest-ServerActionsTestOtherA-977966886 None] Lock "cinder-1f0a6555-6de3-46d8-9e51-2c23f2523b7e-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-45df6e30-3f8f-4163-9503-8dd8bb72f33d tempest-ServerActionsTestOtherA-977966886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-45df6e30-3f8f-4163-9503-8dd8bb72f33d tempest-ServerActionsTestOtherA-977966886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-45df6e30-3f8f-4163-9503-8dd8bb72f33d tempest-ServerActionsTestOtherA-977966886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-45df6e30-3f8f-4163-9503-8dd8bb72f33d tempest-ServerActionsTestOtherA-977966886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-45df6e30-3f8f-4163-9503-8dd8bb72f33d tempest-ServerActionsTestOtherA-977966886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-45df6e30-3f8f-4163-9503-8dd8bb72f33d tempest-ServerActionsTestOtherA-977966886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:59 devstack sudo[94059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:12:59 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:12:59 devstack sudo[94056]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ab86e960-dba2-4b6e-ae18-2384e7a33752 tempest-VolumesExtendTest-727381181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25" returned: 0 in 0.451s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ab86e960-dba2-4b6e-ae18-2384e7a33752 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.02108f14-072f-489f-95b6-4b8abed45633 2G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:12:59 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-45df6e30-3f8f-4163-9503-8dd8bb72f33d tempest-ServerActionsTestOtherA-977966886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.376s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:12:59 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-45df6e30-3f8f-4163-9503-8dd8bb72f33d tempest-ServerActionsTestOtherA-977966886 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:12:59 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-45df6e30-3f8f-4163-9503-8dd8bb72f33d tempest-ServerActionsTestOtherA-977966886 None] Deleted volume successfully. Sep 23 15:13:00 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-45df6e30-3f8f-4163-9503-8dd8bb72f33d tempest-ServerActionsTestOtherA-977966886 None] Lock "cinder-fb778eb5-ab01-4cc7-9290-9db864c337ed-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:13:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ab86e960-dba2-4b6e-ae18-2384e7a33752 tempest-VolumesExtendTest-727381181 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.02108f14-072f-489f-95b6-4b8abed45633 2G" returned: 0 in 0.267s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ab86e960-dba2-4b6e-ae18-2384e7a33752 tempest-VolumesExtendTest-727381181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.805s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:00 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-ab86e960-dba2-4b6e-ae18-2384e7a33752 tempest-VolumesExtendTest-727381181 None] Extend volume completed successfully. Sep 23 15:13:00 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-c4787d4a-d81f-449e-80b9-761d64f3c50b tempest-GroupSnapshotsTest-23436513 None] GroupSnapshot 768a3c16-7168-4c2c-8b39-8d2672542eda: creating. Sep 23 15:13:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c4787d4a-d81f-449e-80b9-761d64f3c50b tempest-GroupSnapshotsTest-23436513 None] Group snapshot 768a3c16-7168-4c2c-8b39-8d2672542eda: creating. {{(pid=86064) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 15:13:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c4787d4a-d81f-449e-80b9-761d64f3c50b tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c4787d4a-d81f-449e-80b9-761d64f3c50b tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-c4787d4a-d81f-449e-80b9-761d64f3c50b tempest-GroupSnapshotsTest-23436513 None] Creating offline snapshot 796604ec-020d-4ee9-992b-1aaddb632b4e of volume 46887b9c-1433-4d72-bfe3-2ad38957472d {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:13:00 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a41de5e-70d4-4240-bf63-8e1f90f82d1b]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c4787d4a-d81f-449e-80b9-761d64f3c50b tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:00 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d Sep 23 15:13:00 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:00 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c4787d4a-d81f-449e-80b9-761d64f3c50b tempest-GroupSnapshotsTest-23436513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d" returned: 0 in 0.459s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c4787d4a-d81f-449e-80b9-761d64f3c50b tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:00 devstack sudo[94077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e 1G Sep 23 15:13:00 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:01 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:01 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] Acquiring lock "cinder-02108f14-072f-489f-95b6-4b8abed45633-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c4787d4a-d81f-449e-80b9-761d64f3c50b tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e 1G" returned: 0 in 0.775s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c4787d4a-d81f-449e-80b9-761d64f3c50b tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46887b9c-1433-4d72-bfe3-2ad38957472d -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:01 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] Lock "cinder-02108f14-072f-489f-95b6-4b8abed45633-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:01 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] Acquiring lock "cinder-quobyte-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:01 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46887b9c-1433-4d72-bfe3-2ad38957472d -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e Sep 23 15:13:01 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:01 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] Lock "cinder-quobyte-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:01 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] Acquiring lock "cinder-quobyte-02108f14-072f-489f-95b6-4b8abed45633" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:01 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] Lock "cinder-quobyte-02108f14-072f-489f-95b6-4b8abed45633" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] Deleting offline snapshot 02108f14-072f-489f-95b6-4b8abed45633 of volume d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:13:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] snapshot_file for this snap is: volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.02108f14-072f-489f-95b6-4b8abed45633 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:13:01 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a38361-a1b3-4858-8abb-ba3c7cc96e24]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.02108f14-072f-489f-95b6-4b8abed45633 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:01 devstack sudo[94107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.02108f14-072f-489f-95b6-4b8abed45633 Sep 23 15:13:01 devstack sudo[94107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:02 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c4787d4a-d81f-449e-80b9-761d64f3c50b tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46887b9c-1433-4d72-bfe3-2ad38957472d -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e" returned: 0 in 0.546s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:02 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-c4787d4a-d81f-449e-80b9-761d64f3c50b tempest-GroupSnapshotsTest-23436513 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e is being set with open permissions: ugo+rw: NotImplementedError Sep 23 15:13:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c4787d4a-d81f-449e-80b9-761d64f3c50b tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:02 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e Sep 23 15:13:02 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:02 devstack sudo[94107]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.02108f14-072f-489f-95b6-4b8abed45633" returned: 0 in 0.645s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:13:02 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ba5e0e-c2fc-4364-88c7-f46a32f09215]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:02 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c4787d4a-d81f-449e-80b9-761d64f3c50b tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e" returned: 0 in 0.397s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c4787d4a-d81f-449e-80b9-761d64f3c50b tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:02 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25 Sep 23 15:13:02 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.info Sep 23 15:13:02 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:02 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:02 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c4787d4a-d81f-449e-80b9-761d64f3c50b tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.info" returned: 0 in 0.467s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:02 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-c4787d4a-d81f-449e-80b9-761d64f3c50b tempest-GroupSnapshotsTest-23436513 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 15:13:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c4787d4a-d81f-449e-80b9-761d64f3c50b tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:03 devstack sudo[94128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.info Sep 23 15:13:03 devstack sudo[94128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:03 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25" returned: 0 in 0.681s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.02108f14-072f-489f-95b6-4b8abed45633 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:03 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.02108f14-072f-489f-95b6-4b8abed45633 Sep 23 15:13:03 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:03 devstack sudo[94128]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c4787d4a-d81f-449e-80b9-761d64f3c50b tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.info" returned: 0 in 0.309s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c4787d4a-d81f-449e-80b9-761d64f3c50b tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.070s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:03 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-c4787d4a-d81f-449e-80b9-761d64f3c50b tempest-GroupSnapshotsTest-23436513 None] group_snapshot 768a3c16-7168-4c2c-8b39-8d2672542eda: created successfully Sep 23 15:13:03 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.02108f14-072f-489f-95b6-4b8abed45633" returned: 0 in 0.654s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.02108f14-072f-489f-95b6-4b8abed45633 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:03 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.02108f14-072f-489f-95b6-4b8abed45633 Sep 23 15:13:03 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:04 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25.02108f14-072f-489f-95b6-4b8abed45633" returned: 0 in 0.298s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] Lock "cinder-quobyte-02108f14-072f-489f-95b6-4b8abed45633" released by "_delete_snapshot" :: held 2.462s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] Lock "cinder-quobyte-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25" released by "delete_snapshot" :: held 2.512s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] Created reservations ['16d09536-3a5c-4b64-a290-e7ae4ebe3156', '1bf490db-22fd-4a0b-b250-68bdfb480a62', 'a3379f45-73a9-47c7-9b6f-f874b154d6a1', 'f01271c6-bea2-4680-b169-1a1894367c9c'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG oslo_db.api [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Sep 23 15:13:04 devstack cinder-volume[86064]: [SQL: SELECT reservations.id AS reservations_id, reservations.uuid AS reservations_uuid, reservations.usage_id AS reservations_usage_id, reservations.project_id AS reservations_project_id, reservations.resource AS reservations_resource, reservations.delta AS reservations_delta, reservations.expire AS reservations_expire, reservations.deleted_at AS reservations_deleted_at, reservations.deleted AS reservations_deleted, reservations.created_at AS reservations_created_at, reservations.updated_at AS reservations_updated_at Sep 23 15:13:04 devstack cinder-volume[86064]: FROM reservations Sep 23 15:13:04 devstack cinder-volume[86064]: WHERE reservations.deleted = false AND reservations.uuid IN (%(uuid_1_1)s, %(uuid_1_2)s, %(uuid_1_3)s, %(uuid_1_4)s) FOR UPDATE] Sep 23 15:13:04 devstack cinder-volume[86064]: [parameters: {'uuid_1_1': '16d09536-3a5c-4b64-a290-e7ae4ebe3156', 'uuid_1_2': '1bf490db-22fd-4a0b-b250-68bdfb480a62', 'uuid_1_3': 'a3379f45-73a9-47c7-9b6f-f874b154d6a1', 'uuid_1_4': 'f01271c6-bea2-4680-b169-1a1894367c9c'}] Sep 23 15:13:04 devstack cinder-volume[86064]: (Background on this error at: https://sqlalche.me/e/20/e3q8) {{(pid=86064) _is_exception_expected /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:184}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG oslo_db.api [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] Performing DB retry for function cinder.db.api.reservation_commit {{(pid=86064) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:155}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "cinder-quobyte-796604ec-020d-4ee9-992b-1aaddb632b4e-158d5e7e-5948-49fc-9df0-71fffb033616" by "_create_volume_from_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-796604ec-020d-4ee9-992b-1aaddb632b4e-158d5e7e-5948-49fc-9df0-71fffb033616" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Creating volume 158d5e7e-5948-49fc-9df0-71fffb033616 from snapshot 796604ec-020d-4ee9-992b-1aaddb632b4e {{(pid=86064) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "cinder-quobyte-158d5e7e-5948-49fc-9df0-71fffb033616" by "_copy_volume_from_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-158d5e7e-5948-49fc-9df0-71fffb033616" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] snapshot: 796604ec-020d-4ee9-992b-1aaddb632b4e, volume: 158d5e7e-5948-49fc-9df0-71fffb033616, {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd3f5e8-7081-4c6b-8b9e-fda39efc76ce]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:04 devstack sudo[94158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e Sep 23 15:13:04 devstack sudo[94158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-16c8ad05-a4ad-41e5-950c-2e12ad0da686 tempest-VolumesExtendTest-727381181 None] Acquiring lock "cinder-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-16c8ad05-a4ad-41e5-950c-2e12ad0da686 tempest-VolumesExtendTest-727381181 None] Lock "cinder-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:04 devstack sudo[94158]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-16c8ad05-a4ad-41e5-950c-2e12ad0da686 tempest-VolumesExtendTest-727381181 None] Acquiring lock "cinder-quobyte-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e" returned: 0 in 0.434s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46887b9c-1433-4d72-bfe3-2ad38957472d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-16c8ad05-a4ad-41e5-950c-2e12ad0da686 tempest-VolumesExtendTest-727381181 None] Lock "cinder-quobyte-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25" acquired by "delete_volume" :: waited 0.026s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:04 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bdc9cb-07b2-4de6-8005-ba343806b29b]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:05 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9ec035-4a3f-4120-a718-a6c09b6bba81]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-16c8ad05-a4ad-41e5-950c-2e12ad0da686 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:05 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d Sep 23 15:13:05 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:05 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25 Sep 23 15:13:05 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:05 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] Delete snapshot completed successfully. Sep 23 15:13:05 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ced6723d-4df6-4665-a684-99f9357f9093 tempest-VolumesExtendTest-727381181 None] Lock "cinder-02108f14-072f-489f-95b6-4b8abed45633-delete_snapshot" released by "delete_snapshot" :: held 3.748s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:13:05 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d" returned: 0 in 0.434s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 15:13:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Creating direct copy from snapshot {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 15:13:05 devstack cinder-volume[86064]: DEBUG cinder.utils [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Path /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-158d5e7e-5948-49fc-9df0-71fffb033616 not found in is_blk_device check {{(pid=86064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 15:13:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-158d5e7e-5948-49fc-9df0-71fffb033616 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:05 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-158d5e7e-5948-49fc-9df0-71fffb033616 Sep 23 15:13:05 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:05 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-16c8ad05-a4ad-41e5-950c-2e12ad0da686 tempest-VolumesExtendTest-727381181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25" returned: 0 in 0.452s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-16c8ad05-a4ad-41e5-950c-2e12ad0da686 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:05 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25 Sep 23 15:13:05 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:05 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-16c8ad05-a4ad-41e5-950c-2e12ad0da686 tempest-VolumesExtendTest-727381181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25" returned: 0 in 0.305s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:05 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-16c8ad05-a4ad-41e5-950c-2e12ad0da686 tempest-VolumesExtendTest-727381181 None] Lock "cinder-quobyte-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25" released by "delete_volume" :: held 0.854s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:13:05 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-16c8ad05-a4ad-41e5-950c-2e12ad0da686 tempest-VolumesExtendTest-727381181 None] Created reservations ['e508ab65-1a95-4331-9b45-ff2615e14c13', 'd7324146-388e-498b-8b44-3db22d1e630f', 'ca8b6cb9-75d3-404e-92c4-06f5ddcb05e7', '929e45e7-5534-4a83-b56b-c48c07749406'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:13:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-16c8ad05-a4ad-41e5-950c-2e12ad0da686 tempest-VolumesExtendTest-727381181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-16c8ad05-a4ad-41e5-950c-2e12ad0da686 tempest-VolumesExtendTest-727381181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-16c8ad05-a4ad-41e5-950c-2e12ad0da686 tempest-VolumesExtendTest-727381181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:13:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-16c8ad05-a4ad-41e5-950c-2e12ad0da686 tempest-VolumesExtendTest-727381181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:13:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-16c8ad05-a4ad-41e5-950c-2e12ad0da686 tempest-VolumesExtendTest-727381181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-16c8ad05-a4ad-41e5-950c-2e12ad0da686 tempest-VolumesExtendTest-727381181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:06 devstack sudo[94196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:13:06 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:06 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-16c8ad05-a4ad-41e5-950c-2e12ad0da686 tempest-VolumesExtendTest-727381181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.435s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:06 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-16c8ad05-a4ad-41e5-950c-2e12ad0da686 tempest-VolumesExtendTest-727381181 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:13:06 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-16c8ad05-a4ad-41e5-950c-2e12ad0da686 tempest-VolumesExtendTest-727381181 None] Deleted volume successfully. Sep 23 15:13:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-16c8ad05-a4ad-41e5-950c-2e12ad0da686 tempest-VolumesExtendTest-727381181 None] Lock "cinder-d9d44e29-2d4c-4f0c-8ad6-cd0644f8eb25-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:13:15 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-158d5e7e-5948-49fc-9df0-71fffb033616" returned: 0 in 9.829s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d, size 1024.00 MB, duration 9.83 sec, destination /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-158d5e7e-5948-49fc-9df0-71fffb033616 {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:13:15 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Converted 1024.00 MB image at 104.17 MB/s Sep 23 15:13:15 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-158d5e7e-5948-49fc-9df0-71fffb033616 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-158d5e7e-5948-49fc-9df0-71fffb033616 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:15 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-158d5e7e-5948-49fc-9df0-71fffb033616 Sep 23 15:13:15 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:13:15 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Flow 'volume_create_manager' (124a666d-9a63-49dc-9e80-14d9fa7c0e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3bf1b14-014e-44a9-8234-b78d64bd7326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-158d5e7e-5948-49fc-9df0-71fffb033616" returned: 0 in 0.398s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3bf1b14-014e-44a9-8234-b78d64bd7326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1855589105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3fd08d6-a272-4647-bd44-c6e0f71e139f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='69c0a8089a4e4d85a67357adc5e38c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:13:16Z,use_quota=True,user_id='df3159505d304665930ae644bb17d08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae6b612-c478-4d3d-95bc-32c79de223ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae6b612-c478-4d3d-95bc-32c79de223ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08087803-dcf9-46fa-823b-17029e8e611c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08087803-dcf9-46fa-823b-17029e8e611c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3fd08d6-a272-4647-bd44-c6e0f71e139f', 'volume_name': 'volume-f3fd08d6-a272-4647-bd44-c6e0f71e139f', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8752cc94-859a-4a9f-87a2-1961a1544894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8752cc94-859a-4a9f-87a2-1961a1544894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dc08d5a-3432-418b-bdb8-afe9c0423ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:15 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Volume f3fd08d6-a272-4647-bd44-c6e0f71e139f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3fd08d6-a272-4647-bd44-c6e0f71e139f', 'volume_size': 1} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-158d5e7e-5948-49fc-9df0-71fffb033616" released by "_copy_volume_from_snapshot" :: held 11.275s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-796604ec-020d-4ee9-992b-1aaddb632b4e-158d5e7e-5948-49fc-9df0-71fffb033616" released by "_create_volume_from_snapshot" :: held 11.345s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.369s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.045s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1855589105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3fd08d6-a272-4647-bd44-c6e0f71e139f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='69c0a8089a4e4d85a67357adc5e38c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:13:16Z,use_quota=True,user_id='df3159505d304665930ae644bb17d08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Creating volume f3fd08d6-a272-4647-bd44-c6e0f71e139f {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:13:15 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:13:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f3fd08d6-a272-4647-bd44-c6e0f71e139f 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:15 devstack sudo[94265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f3fd08d6-a272-4647-bd44-c6e0f71e139f 1073741824 Sep 23 15:13:15 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:16 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-38d7615b-7be8-4abd-b193-dffeff9ba1b4 tempest-GroupSnapshotsTest-23436513 None] Create group from source-snapshot-768a3c16-7168-4c2c-8b39-8d2672542eda completed successfully. Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Flow 'volume_create_manager' (7261bc8d-3cef-4bb6-8eb5-ce24a2dc2c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502c65c4-6f28-427a-b877-98a34f2ecacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502c65c4-6f28-427a-b877-98a34f2ecacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-200179660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d80cfc-2444-498a-b956-bdf8bdffaa4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ad7a3651d14753914140d3aa290ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:13:16Z,use_quota=True,user_id='8ec2ca8a1c2a4a30a051aa0ca7d882e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f432179-ce30-47fd-9ffa-e8f55af4349f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f432179-ce30-47fd-9ffa-e8f55af4349f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1aaa0f-5843-4a56-8b91-7d9303b747d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1aaa0f-5843-4a56-8b91-7d9303b747d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58d80cfc-2444-498a-b956-bdf8bdffaa4e', 'volume_name': 'volume-58d80cfc-2444-498a-b956-bdf8bdffaa4e', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c013fb-08d8-4503-9f9f-5b2600f0519f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c013fb-08d8-4503-9f9f-5b2600f0519f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef21ae5f-338e-4c77-b0f1-4bbb8be653f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:16 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Volume 58d80cfc-2444-498a-b956-bdf8bdffaa4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58d80cfc-2444-498a-b956-bdf8bdffaa4e', 'volume_size': 1} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:16 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f3fd08d6-a272-4647-bd44-c6e0f71e139f 1073741824" returned: 0 in 0.664s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f3fd08d6-a272-4647-bd44-c6e0f71e139f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:16 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f3fd08d6-a272-4647-bd44-c6e0f71e139f Sep 23 15:13:16 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:16 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f3fd08d6-a272-4647-bd44-c6e0f71e139f" returned: 0 in 0.289s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.614s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-200179660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d80cfc-2444-498a-b956-bdf8bdffaa4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ad7a3651d14753914140d3aa290ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:13:16Z,use_quota=True,user_id='8ec2ca8a1c2a4a30a051aa0ca7d882e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Creating volume 58d80cfc-2444-498a-b956-bdf8bdffaa4e {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:13:16 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-58d80cfc-2444-498a-b956-bdf8bdffaa4e 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:16 devstack sudo[94275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-58d80cfc-2444-498a-b956-bdf8bdffaa4e 1073741824 Sep 23 15:13:16 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dc08d5a-3432-418b-bdb8-afe9c0423ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3fd08d6-a272-4647-bd44-c6e0f71e139f', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9210d267-4a12-4515-b661-b54b034bfd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:16 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Volume volume-f3fd08d6-a272-4647-bd44-c6e0f71e139f (f3fd08d6-a272-4647-bd44-c6e0f71e139f): created successfully Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9210d267-4a12-4515-b661-b54b034bfd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Flow 'volume_create_manager' (124a666d-9a63-49dc-9e80-14d9fa7c0e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3e886c46-5916-48c0-85fc-2d3ae970e9a5 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "cinder-quobyte-158d5e7e-5948-49fc-9df0-71fffb033616" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:16 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-8c8d7ee2-948a-44c4-9e8e-d137330c8235 tempest-VolumesGetTest-1118423804 None] Created volume successfully. Sep 23 15:13:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3e886c46-5916-48c0-85fc-2d3ae970e9a5 tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-158d5e7e-5948-49fc-9df0-71fffb033616" acquired by "delete_volume" :: waited 0.032s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:17 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0454dbb-0364-47c4-ad53-1cd932558ec8]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e886c46-5916-48c0-85fc-2d3ae970e9a5 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-158d5e7e-5948-49fc-9df0-71fffb033616 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:17 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-158d5e7e-5948-49fc-9df0-71fffb033616 Sep 23 15:13:17 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:17 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-58d80cfc-2444-498a-b956-bdf8bdffaa4e 1073741824" returned: 0 in 0.565s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-58d80cfc-2444-498a-b956-bdf8bdffaa4e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:17 devstack sudo[94286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-58d80cfc-2444-498a-b956-bdf8bdffaa4e Sep 23 15:13:17 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:17 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e886c46-5916-48c0-85fc-2d3ae970e9a5 tempest-GroupSnapshotsTest-23436513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-158d5e7e-5948-49fc-9df0-71fffb033616" returned: 0 in 0.459s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e886c46-5916-48c0-85fc-2d3ae970e9a5 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-158d5e7e-5948-49fc-9df0-71fffb033616 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:17 devstack sudo[94288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-158d5e7e-5948-49fc-9df0-71fffb033616 Sep 23 15:13:17 devstack sudo[94288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:17 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-58d80cfc-2444-498a-b956-bdf8bdffaa4e" returned: 0 in 0.276s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:13:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef21ae5f-338e-4c77-b0f1-4bbb8be653f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58d80cfc-2444-498a-b956-bdf8bdffaa4e', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb658b2b-1b80-4a31-8ae9-1a328cf5043b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:17 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Volume volume-58d80cfc-2444-498a-b956-bdf8bdffaa4e (58d80cfc-2444-498a-b956-bdf8bdffaa4e): created successfully Sep 23 15:13:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb658b2b-1b80-4a31-8ae9-1a328cf5043b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Flow 'volume_create_manager' (7261bc8d-3cef-4bb6-8eb5-ce24a2dc2c7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:13:17 devstack sudo[94288]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e886c46-5916-48c0-85fc-2d3ae970e9a5 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-158d5e7e-5948-49fc-9df0-71fffb033616" returned: 0 in 0.295s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:17 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5148bb63-c018-4c76-b4b8-e3c74eca269f tempest-AttachVolumeTestJSON-1693410156 None] Created volume successfully. Sep 23 15:13:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3e886c46-5916-48c0-85fc-2d3ae970e9a5 tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-158d5e7e-5948-49fc-9df0-71fffb033616" released by "delete_volume" :: held 0.820s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:13:17 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-3e886c46-5916-48c0-85fc-2d3ae970e9a5 tempest-GroupSnapshotsTest-23436513 None] Created reservations ['48d79f3b-d6d8-46fb-9d41-f40d2c269f63'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:13:17 devstack cinder-volume[86064]: WARNING cinder.quota [None req-3e886c46-5916-48c0-85fc-2d3ae970e9a5 tempest-GroupSnapshotsTest-23436513 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1802322072 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1802322072, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:13:17 devstack cinder-volume[86064]: WARNING cinder.quota [None req-3e886c46-5916-48c0-85fc-2d3ae970e9a5 tempest-GroupSnapshotsTest-23436513 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1802322072 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1802322072, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:13:17 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-3e886c46-5916-48c0-85fc-2d3ae970e9a5 tempest-GroupSnapshotsTest-23436513 None] Created reservations ['5f2efca4-a2f7-4ba8-998c-15a575a96200', 'a9b8dea3-2222-4c56-9487-61c1deaae01b', '6641650a-2055-4a43-bf62-cb3d8e22509d', '4652923d-f109-4bfa-bf17-121bde6318f0'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:13:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3e886c46-5916-48c0-85fc-2d3ae970e9a5 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3e886c46-5916-48c0-85fc-2d3ae970e9a5 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3e886c46-5916-48c0-85fc-2d3ae970e9a5 tempest-GroupSnapshotsTest-23436513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:13:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3e886c46-5916-48c0-85fc-2d3ae970e9a5 tempest-GroupSnapshotsTest-23436513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:13:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3e886c46-5916-48c0-85fc-2d3ae970e9a5 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e886c46-5916-48c0-85fc-2d3ae970e9a5 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:18 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:13:18 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:18 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-24463e62-d9a4-4619-b2ba-af09ef7860e1 tempest-GroupSnapshotsTest-23436513 None] group_snapshot 768a3c16-7168-4c2c-8b39-8d2672542eda: deleting Sep 23 15:13:18 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-24463e62-d9a4-4619-b2ba-af09ef7860e1 tempest-GroupSnapshotsTest-23436513 None] group_snapshot 768a3c16-7168-4c2c-8b39-8d2672542eda: deleting {{(pid=86064) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 15:13:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-24463e62-d9a4-4619-b2ba-af09ef7860e1 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "cinder-quobyte-46887b9c-1433-4d72-bfe3-2ad38957472d" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-24463e62-d9a4-4619-b2ba-af09ef7860e1 tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-46887b9c-1433-4d72-bfe3-2ad38957472d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-24463e62-d9a4-4619-b2ba-af09ef7860e1 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "cinder-quobyte-796604ec-020d-4ee9-992b-1aaddb632b4e" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-24463e62-d9a4-4619-b2ba-af09ef7860e1 tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-796604ec-020d-4ee9-992b-1aaddb632b4e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-24463e62-d9a4-4619-b2ba-af09ef7860e1 tempest-GroupSnapshotsTest-23436513 None] Deleting offline snapshot 796604ec-020d-4ee9-992b-1aaddb632b4e of volume 46887b9c-1433-4d72-bfe3-2ad38957472d {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:13:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-24463e62-d9a4-4619-b2ba-af09ef7860e1 tempest-GroupSnapshotsTest-23436513 None] snapshot_file for this snap is: volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:13:18 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e886c46-5916-48c0-85fc-2d3ae970e9a5 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.431s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:18 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-3e886c46-5916-48c0-85fc-2d3ae970e9a5 tempest-GroupSnapshotsTest-23436513 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:13:18 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-3e886c46-5916-48c0-85fc-2d3ae970e9a5 tempest-GroupSnapshotsTest-23436513 None] Delete group completed successfully. Sep 23 15:13:18 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0c7520-acb6-4dc9-8b95-4fdf4af07b26]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-24463e62-d9a4-4619-b2ba-af09ef7860e1 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:18 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e Sep 23 15:13:18 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:19 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-24463e62-d9a4-4619-b2ba-af09ef7860e1 tempest-GroupSnapshotsTest-23436513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e" returned: 0 in 0.535s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-24463e62-d9a4-4619-b2ba-af09ef7860e1 tempest-GroupSnapshotsTest-23436513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46887b9c-1433-4d72-bfe3-2ad38957472d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b77f4a1-58b7-465e-ab42-af551784bbe5]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-24463e62-d9a4-4619-b2ba-af09ef7860e1 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Flow 'volume_create_manager' (70864efd-59b9-4afb-bfc7-0a5763d56b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:13:19 devstack sudo[94304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d Sep 23 15:13:19 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (451a0786-d483-4870-8577-af2269629f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (451a0786-d483-4870-8577-af2269629f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:13:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2054471414',display_name='tempest-VolumesGetTest-Volume-752688381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a8e61e-43f4-41ec-a8da-9ae51e97a081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c0a8089a4e4d85a67357adc5e38c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:13:19Z,use_quota=True,user_id='df3159505d304665930ae644bb17d08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b23e5f-2356-4d41-b5e8-03cd5ae90869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b23e5f-2356-4d41-b5e8-03cd5ae90869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb8b604e-7504-4543-a9dc-c7e12d07c454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb8b604e-7504-4543-a9dc-c7e12d07c454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a8e61e-43f4-41ec-a8da-9ae51e97a081', 'volume_name': 'volume-a6a8e61e-43f4-41ec-a8da-9ae51e97a081', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0707ba-bd05-4284-8bd8-d8fefcba9c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0707ba-bd05-4284-8bd8-d8fefcba9c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aac0813-887d-4d5a-8e84-62e235812347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:19 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Volume a6a8e61e-43f4-41ec-a8da-9ae51e97a081: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a8e61e-43f4-41ec-a8da-9ae51e97a081', 'volume_size': 1} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:13:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2054471414',display_name='tempest-VolumesGetTest-Volume-752688381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a8e61e-43f4-41ec-a8da-9ae51e97a081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c0a8089a4e4d85a67357adc5e38c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:13:19Z,use_quota=True,user_id='df3159505d304665930ae644bb17d08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Creating volume a6a8e61e-43f4-41ec-a8da-9ae51e97a081 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:13:19 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a6a8e61e-43f4-41ec-a8da-9ae51e97a081 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:19 devstack sudo[94309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a6a8e61e-43f4-41ec-a8da-9ae51e97a081 1073741824 Sep 23 15:13:19 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-6c30337d-11ae-4005-bcfb-24cc94a1e196 req-e6c0bdd1-fefd-43a3-9a42-36c9a7f0c0b1 tempest-AttachVolumeTestJSON-1693410156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:19 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-24463e62-d9a4-4619-b2ba-af09ef7860e1 tempest-GroupSnapshotsTest-23436513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d" returned: 0 in 0.713s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-24463e62-d9a4-4619-b2ba-af09ef7860e1 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:19 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e Sep 23 15:13:19 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:19 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a6a8e61e-43f4-41ec-a8da-9ae51e97a081 1073741824" returned: 0 in 0.566s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a6a8e61e-43f4-41ec-a8da-9ae51e97a081 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:20 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a6a8e61e-43f4-41ec-a8da-9ae51e97a081 Sep 23 15:13:20 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:20 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a6a8e61e-43f4-41ec-a8da-9ae51e97a081" returned: 0 in 0.348s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:13:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:20 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-6c30337d-11ae-4005-bcfb-24cc94a1e196 req-e6c0bdd1-fefd-43a3-9a42-36c9a7f0c0b1 tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.736s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:20 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=120,cinder:INSERT=33,cinder:UPDATE=121,cinder:DELETE=5 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:13:20 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=107,cinder:UPDATE=118,cinder:DELETE=12,cinder:INSERT=34 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:13:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-24463e62-d9a4-4619-b2ba-af09ef7860e1 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e" returned: 0 in 0.540s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-24463e62-d9a4-4619-b2ba-af09ef7860e1 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aac0813-887d-4d5a-8e84-62e235812347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a8e61e-43f4-41ec-a8da-9ae51e97a081', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:20 devstack sudo[94334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e Sep 23 15:13:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48647256-dfc6-430e-a4ba-6ad65889248c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:20 devstack sudo[94334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-6c30337d-11ae-4005-bcfb-24cc94a1e196 req-e6c0bdd1-fefd-43a3-9a42-36c9a7f0c0b1 tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.056s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:20 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Volume volume-a6a8e61e-43f4-41ec-a8da-9ae51e97a081 (a6a8e61e-43f4-41ec-a8da-9ae51e97a081): created successfully Sep 23 15:13:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48647256-dfc6-430e-a4ba-6ad65889248c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Flow 'volume_create_manager' (70864efd-59b9-4afb-bfc7-0a5763d56b12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:13:20 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-d12a1fe9-5ac0-4731-b93f-b084a95970e4 tempest-VolumesGetTest-1118423804 None] Created volume successfully. Sep 23 15:13:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-6c30337d-11ae-4005-bcfb-24cc94a1e196 req-e6c0bdd1-fefd-43a3-9a42-36c9a7f0c0b1 tempest-AttachVolumeTestJSON-1693410156 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-58d80cfc-2444-498a-b956-bdf8bdffaa4e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '051bde8d-70e9-4b00-aa3d-68d442a1fb14', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:13:20 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-6c30337d-11ae-4005-bcfb-24cc94a1e196 req-e6c0bdd1-fefd-43a3-9a42-36c9a7f0c0b1 tempest-AttachVolumeTestJSON-1693410156 None] attachment_update completed successfully. Sep 23 15:13:20 devstack sudo[94334]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-24463e62-d9a4-4619-b2ba-af09ef7860e1 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d.796604ec-020d-4ee9-992b-1aaddb632b4e" returned: 0 in 0.298s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-24463e62-d9a4-4619-b2ba-af09ef7860e1 tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-796604ec-020d-4ee9-992b-1aaddb632b4e" released by "_delete_snapshot" :: held 2.266s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:13:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-24463e62-d9a4-4619-b2ba-af09ef7860e1 tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-46887b9c-1433-4d72-bfe3-2ad38957472d" released by "delete_snapshot" :: held 2.305s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:13:20 devstack cinder-volume[86064]: WARNING cinder.quota [None req-24463e62-d9a4-4619-b2ba-af09ef7860e1 tempest-GroupSnapshotsTest-23436513 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1802322072 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1802322072, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:13:20 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-24463e62-d9a4-4619-b2ba-af09ef7860e1 tempest-GroupSnapshotsTest-23436513 None] Created reservations ['99c79916-6871-4def-bb88-0aef2f98127b', '5239afc9-4a5f-40ab-ad7e-e7f85d9a4823', 'cbf35507-523e-4fd6-8385-edfbfa1d87d8', 'ef77e6fd-fade-45a5-8234-00dcbd4a6b2f'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:13:21 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-24463e62-d9a4-4619-b2ba-af09ef7860e1 tempest-GroupSnapshotsTest-23436513 None] group_snapshot 768a3c16-7168-4c2c-8b39-8d2672542eda: deleted successfully Sep 23 15:13:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-12bd0772-88d0-4cef-a3cc-f4d3ed2e22d8 tempest-VolumesGetTest-1118423804 None] Acquiring lock "cinder-a6a8e61e-43f4-41ec-a8da-9ae51e97a081-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-12bd0772-88d0-4cef-a3cc-f4d3ed2e22d8 tempest-VolumesGetTest-1118423804 None] Lock "cinder-a6a8e61e-43f4-41ec-a8da-9ae51e97a081-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-12bd0772-88d0-4cef-a3cc-f4d3ed2e22d8 tempest-VolumesGetTest-1118423804 None] Acquiring lock "cinder-quobyte-a6a8e61e-43f4-41ec-a8da-9ae51e97a081" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-12bd0772-88d0-4cef-a3cc-f4d3ed2e22d8 tempest-VolumesGetTest-1118423804 None] Lock "cinder-quobyte-a6a8e61e-43f4-41ec-a8da-9ae51e97a081" acquired by "delete_volume" :: waited 0.030s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:21 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c1d06d-d23f-4c2c-bddd-693ca4d8a5ea]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-12bd0772-88d0-4cef-a3cc-f4d3ed2e22d8 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a6a8e61e-43f4-41ec-a8da-9ae51e97a081 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:21 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a6a8e61e-43f4-41ec-a8da-9ae51e97a081 Sep 23 15:13:21 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f9e557fd-80a5-4652-acbf-bb3e46cc170b tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "cinder-quobyte-46887b9c-1433-4d72-bfe3-2ad38957472d" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f9e557fd-80a5-4652-acbf-bb3e46cc170b tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-46887b9c-1433-4d72-bfe3-2ad38957472d" acquired by "delete_volume" :: waited 0.015s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:22 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-12bd0772-88d0-4cef-a3cc-f4d3ed2e22d8 tempest-VolumesGetTest-1118423804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a6a8e61e-43f4-41ec-a8da-9ae51e97a081" returned: 0 in 0.616s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-12bd0772-88d0-4cef-a3cc-f4d3ed2e22d8 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a6a8e61e-43f4-41ec-a8da-9ae51e97a081 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:22 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c22eb5-40d4-4621-98a5-2bae75b68bb9]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f9e557fd-80a5-4652-acbf-bb3e46cc170b tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:22 devstack sudo[94757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a6a8e61e-43f4-41ec-a8da-9ae51e97a081 Sep 23 15:13:22 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:22 devstack sudo[94758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d Sep 23 15:13:22 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:22 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-12bd0772-88d0-4cef-a3cc-f4d3ed2e22d8 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a6a8e61e-43f4-41ec-a8da-9ae51e97a081" returned: 0 in 0.373s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-12bd0772-88d0-4cef-a3cc-f4d3ed2e22d8 tempest-VolumesGetTest-1118423804 None] Lock "cinder-quobyte-a6a8e61e-43f4-41ec-a8da-9ae51e97a081" released by "delete_volume" :: held 1.050s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:13:22 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-12bd0772-88d0-4cef-a3cc-f4d3ed2e22d8 tempest-VolumesGetTest-1118423804 None] Created reservations ['3054119e-e911-4be6-87d1-e9a15a3b6f1d', 'dcf07b64-5a4e-44f9-a9e2-cecb6396dc0d', '166348af-893f-424c-84c5-0d6569852f64', '67a7419f-e696-40f2-b9c1-820ffe72efe1'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:13:22 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f9e557fd-80a5-4652-acbf-bb3e46cc170b tempest-GroupSnapshotsTest-23436513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d" returned: 0 in 0.476s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f9e557fd-80a5-4652-acbf-bb3e46cc170b tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:22 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d Sep 23 15:13:22 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-12bd0772-88d0-4cef-a3cc-f4d3ed2e22d8 tempest-VolumesGetTest-1118423804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-12bd0772-88d0-4cef-a3cc-f4d3ed2e22d8 tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-12bd0772-88d0-4cef-a3cc-f4d3ed2e22d8 tempest-VolumesGetTest-1118423804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:13:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-12bd0772-88d0-4cef-a3cc-f4d3ed2e22d8 tempest-VolumesGetTest-1118423804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:13:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-12bd0772-88d0-4cef-a3cc-f4d3ed2e22d8 tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-12bd0772-88d0-4cef-a3cc-f4d3ed2e22d8 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:22 devstack sudo[94773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:13:22 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:23 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f9e557fd-80a5-4652-acbf-bb3e46cc170b tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-46887b9c-1433-4d72-bfe3-2ad38957472d" returned: 0 in 0.309s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f9e557fd-80a5-4652-acbf-bb3e46cc170b tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-46887b9c-1433-4d72-bfe3-2ad38957472d" released by "delete_volume" :: held 0.903s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:13:23 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-12bd0772-88d0-4cef-a3cc-f4d3ed2e22d8 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.299s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:23 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-12bd0772-88d0-4cef-a3cc-f4d3ed2e22d8 tempest-VolumesGetTest-1118423804 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:13:23 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-12bd0772-88d0-4cef-a3cc-f4d3ed2e22d8 tempest-VolumesGetTest-1118423804 None] Deleted volume successfully. Sep 23 15:13:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-12bd0772-88d0-4cef-a3cc-f4d3ed2e22d8 tempest-VolumesGetTest-1118423804 None] Lock "cinder-a6a8e61e-43f4-41ec-a8da-9ae51e97a081-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:13:23 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-f9e557fd-80a5-4652-acbf-bb3e46cc170b tempest-GroupSnapshotsTest-23436513 None] Created reservations ['15e5c89f-bfeb-4cf1-86cb-caafc7f35ec0'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:13:23 devstack cinder-volume[86064]: WARNING cinder.db.api [None req-f9e557fd-80a5-4652-acbf-bb3e46cc170b tempest-GroupSnapshotsTest-23436513 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1802322072'] Sep 23 15:13:23 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-f9e557fd-80a5-4652-acbf-bb3e46cc170b tempest-GroupSnapshotsTest-23436513 None] Created reservations ['57df228b-ce21-43d2-a0c9-074fc45f247b', 'fc8ddb12-4479-4c9b-98d7-88138365cdc6', '63d92c2d-9b9b-49c0-85a6-3c6ef3b447f7', 'f86b2abc-36e0-4624-b994-c765622105f2'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:13:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f9e557fd-80a5-4652-acbf-bb3e46cc170b tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f9e557fd-80a5-4652-acbf-bb3e46cc170b tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:23 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f9e557fd-80a5-4652-acbf-bb3e46cc170b tempest-GroupSnapshotsTest-23436513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:13:23 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f9e557fd-80a5-4652-acbf-bb3e46cc170b tempest-GroupSnapshotsTest-23436513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:13:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f9e557fd-80a5-4652-acbf-bb3e46cc170b tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f9e557fd-80a5-4652-acbf-bb3e46cc170b tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:23 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:13:23 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:23 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f9e557fd-80a5-4652-acbf-bb3e46cc170b tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.342s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:23 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-f9e557fd-80a5-4652-acbf-bb3e46cc170b tempest-GroupSnapshotsTest-23436513 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:13:23 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f9e557fd-80a5-4652-acbf-bb3e46cc170b tempest-GroupSnapshotsTest-23436513 None] Delete group completed successfully. Sep 23 15:13:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8f15c7e7-2690-4b41-b089-9e9258501cb4 tempest-VolumesGetTest-1118423804 None] Acquiring lock "cinder-f3fd08d6-a272-4647-bd44-c6e0f71e139f-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8f15c7e7-2690-4b41-b089-9e9258501cb4 tempest-VolumesGetTest-1118423804 None] Lock "cinder-f3fd08d6-a272-4647-bd44-c6e0f71e139f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8f15c7e7-2690-4b41-b089-9e9258501cb4 tempest-VolumesGetTest-1118423804 None] Acquiring lock "cinder-quobyte-f3fd08d6-a272-4647-bd44-c6e0f71e139f" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8f15c7e7-2690-4b41-b089-9e9258501cb4 tempest-VolumesGetTest-1118423804 None] Lock "cinder-quobyte-f3fd08d6-a272-4647-bd44-c6e0f71e139f" acquired by "delete_volume" :: waited 0.029s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:24 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9bf1d0-09d7-4783-b805-87d37ac7c3a3]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f15c7e7-2690-4b41-b089-9e9258501cb4 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f3fd08d6-a272-4647-bd44-c6e0f71e139f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:24 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-97d12a1f-29f7-4767-9996-1492e642faeb tempest-GroupSnapshotsTest-23436513 None] Group tempest-GroupSnapshotsTest-Group-231769444: creating Sep 23 15:13:24 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-97d12a1f-29f7-4767-9996-1492e642faeb tempest-GroupSnapshotsTest-23436513 None] Group tempest-GroupSnapshotsTest-Group-231769444: created successfully Sep 23 15:13:24 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-97d12a1f-29f7-4767-9996-1492e642faeb tempest-GroupSnapshotsTest-23436513 None] Create group completed successfully. Sep 23 15:13:24 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f3fd08d6-a272-4647-bd44-c6e0f71e139f Sep 23 15:13:24 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:24 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f15c7e7-2690-4b41-b089-9e9258501cb4 tempest-VolumesGetTest-1118423804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f3fd08d6-a272-4647-bd44-c6e0f71e139f" returned: 0 in 0.455s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f15c7e7-2690-4b41-b089-9e9258501cb4 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f3fd08d6-a272-4647-bd44-c6e0f71e139f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:24 devstack sudo[94792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f3fd08d6-a272-4647-bd44-c6e0f71e139f Sep 23 15:13:24 devstack sudo[94792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:25 devstack sudo[94792]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f15c7e7-2690-4b41-b089-9e9258501cb4 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f3fd08d6-a272-4647-bd44-c6e0f71e139f" returned: 0 in 0.364s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:25 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8f15c7e7-2690-4b41-b089-9e9258501cb4 tempest-VolumesGetTest-1118423804 None] Lock "cinder-quobyte-f3fd08d6-a272-4647-bd44-c6e0f71e139f" released by "delete_volume" :: held 0.926s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:13:25 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-8f15c7e7-2690-4b41-b089-9e9258501cb4 tempest-VolumesGetTest-1118423804 None] Created reservations ['3fd69483-8fee-4ec9-b6a1-a4369a048057', '9bbe993b-dbf0-427e-9287-4f51ba94382e', 'ce69144e-8b24-4b9c-9aa9-e932c3f67328', 'c38aa1eb-4fd1-4852-a9ed-e07d9f9ba9e6'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:13:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8f15c7e7-2690-4b41-b089-9e9258501cb4 tempest-VolumesGetTest-1118423804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8f15c7e7-2690-4b41-b089-9e9258501cb4 tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8f15c7e7-2690-4b41-b089-9e9258501cb4 tempest-VolumesGetTest-1118423804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:13:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8f15c7e7-2690-4b41-b089-9e9258501cb4 tempest-VolumesGetTest-1118423804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:13:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8f15c7e7-2690-4b41-b089-9e9258501cb4 tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f15c7e7-2690-4b41-b089-9e9258501cb4 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:25 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:13:25 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:25 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f15c7e7-2690-4b41-b089-9e9258501cb4 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.392s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:25 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-8f15c7e7-2690-4b41-b089-9e9258501cb4 tempest-VolumesGetTest-1118423804 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:13:25 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-8f15c7e7-2690-4b41-b089-9e9258501cb4 tempest-VolumesGetTest-1118423804 None] Deleted volume successfully. Sep 23 15:13:25 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8f15c7e7-2690-4b41-b089-9e9258501cb4 tempest-VolumesGetTest-1118423804 None] Lock "cinder-f3fd08d6-a272-4647-bd44-c6e0f71e139f-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:13:26 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:13:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Flow 'volume_create_manager' (50d1b60d-f734-4d0f-b71c-b473741c9438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:13:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4147c830-750e-49e3-bc30-2e9644602d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4147c830-750e-49e3-bc30-2e9644602d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1319302367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ee295cb-bb63-4bf5-98e8-8291b54354b0,host='devstack@QuobyteHD#QuobyteHD',id=e00990f2-56ae-45e2-abb2-82f64093f3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6417a03110574e56904e3066416b5cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:13:26Z,use_quota=True,user_id='155b99cd87234e69a375688e5fef68a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a11b6f23-c5e1-4885-af51-d6b515a3132b),volume_type_id=a11b6f23-c5e1-4885-af51-d6b515a3132b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ff4c2e-af67-4df0-bc98-e43421cd1176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ff4c2e-af67-4df0-bc98-e43421cd1176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8f815b-55d3-4877-acd5-6984a76c2ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8f815b-55d3-4877-acd5-6984a76c2ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e00990f2-56ae-45e2-abb2-82f64093f3db', 'volume_name': 'volume-e00990f2-56ae-45e2-abb2-82f64093f3db', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92596683-2d1a-41ab-a3f8-f9e57ad9c5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92596683-2d1a-41ab-a3f8-f9e57ad9c5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbc54ca-0baf-4b25-a3a8-ed89e19a50d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:26 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Volume e00990f2-56ae-45e2-abb2-82f64093f3db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e00990f2-56ae-45e2-abb2-82f64093f3db', 'volume_size': 1} Sep 23 15:13:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9ee295cb-bb63-4bf5-98e8-8291b54354b0,created_at=2026-09-23T13:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1319302367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ee295cb-bb63-4bf5-98e8-8291b54354b0,host='devstack@QuobyteHD#QuobyteHD',id=e00990f2-56ae-45e2-abb2-82f64093f3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6417a03110574e56904e3066416b5cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:13:26Z,use_quota=True,user_id='155b99cd87234e69a375688e5fef68a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a11b6f23-c5e1-4885-af51-d6b515a3132b),volume_type_id=a11b6f23-c5e1-4885-af51-d6b515a3132b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:13:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Creating volume e00990f2-56ae-45e2-abb2-82f64093f3db {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:13:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:13:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:13:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:13:26 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:13:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:26 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db 1073741824 Sep 23 15:13:26 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:27 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:13:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Flow 'volume_create_manager' (32923c12-213d-4302-b351-f1bb4fe4d1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:13:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75033b75-af2a-4268-87c7-7645cf9be967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75033b75-af2a-4268-87c7-7645cf9be967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-178957602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5fcae56-1ae5-4763-949d-943f94b69b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c0a8089a4e4d85a67357adc5e38c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:13:27Z,use_quota=True,user_id='df3159505d304665930ae644bb17d08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384228e8-9305-4db5-b044-e8a58ecdbd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384228e8-9305-4db5-b044-e8a58ecdbd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acbf7ef-49bf-456f-a8c4-9062c261969c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acbf7ef-49bf-456f-a8c4-9062c261969c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5fcae56-1ae5-4763-949d-943f94b69b54', 'volume_name': 'volume-d5fcae56-1ae5-4763-949d-943f94b69b54', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d97d5f1-5d58-43fb-b0e7-3922efcfa9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d97d5f1-5d58-43fb-b0e7-3922efcfa9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e22544-45bb-44a0-8b56-70edda836320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:27 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Volume d5fcae56-1ae5-4763-949d-943f94b69b54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5fcae56-1ae5-4763-949d-943f94b69b54', 'volume_size': 1} Sep 23 15:13:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:27 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db 1073741824" returned: 0 in 0.944s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:27 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db Sep 23 15:13:27 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:28 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db" returned: 0 in 0.484s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:13:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.719s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-178957602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5fcae56-1ae5-4763-949d-943f94b69b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c0a8089a4e4d85a67357adc5e38c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:13:27Z,use_quota=True,user_id='df3159505d304665930ae644bb17d08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:13:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Creating volume d5fcae56-1ae5-4763-949d-943f94b69b54 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:13:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:13:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:13:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:13:28 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:13:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbc54ca-0baf-4b25-a3a8-ed89e19a50d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e00990f2-56ae-45e2-abb2-82f64093f3db', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f57320-552e-45f5-9ac5-67f19d6aa8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:28 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54 1073741824 Sep 23 15:13:28 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:28 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Volume volume-e00990f2-56ae-45e2-abb2-82f64093f3db (e00990f2-56ae-45e2-abb2-82f64093f3db): created successfully Sep 23 15:13:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f57320-552e-45f5-9ac5-67f19d6aa8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Flow 'volume_create_manager' (50d1b60d-f734-4d0f-b71c-b473741c9438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:13:28 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-179340c2-26cd-4bee-b1d6-1653e5057425 tempest-GroupSnapshotsTest-23436513 None] Created volume successfully. Sep 23 15:13:28 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54 1073741824" returned: 0 in 0.588s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:28 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54 Sep 23 15:13:28 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:29 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54" returned: 0 in 0.654s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:13:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e22544-45bb-44a0-8b56-70edda836320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5fcae56-1ae5-4763-949d-943f94b69b54', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6605df9c-c700-4efa-b34d-ec0c369d8c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:29 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Volume volume-d5fcae56-1ae5-4763-949d-943f94b69b54 (d5fcae56-1ae5-4763-949d-943f94b69b54): created successfully Sep 23 15:13:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6605df9c-c700-4efa-b34d-ec0c369d8c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Flow 'volume_create_manager' (32923c12-213d-4302-b351-f1bb4fe4d1ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:13:29 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-4fad63a0-1fba-43e0-bdb1-245c4afedb9b tempest-VolumesGetTest-1118423804 None] Created volume successfully. Sep 23 15:13:30 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:13:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Flow 'volume_create_manager' (859c3b5e-18d2-40eb-883c-45c07b3ae237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:13:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f50e614-347f-4a46-b6f2-ae048b10874b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f50e614-347f-4a46-b6f2-ae048b10874b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1469108411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ee295cb-bb63-4bf5-98e8-8291b54354b0,host='devstack@QuobyteHD#QuobyteHD',id=b7a72515-d309-4a9e-a142-985e956295d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6417a03110574e56904e3066416b5cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:13:30Z,use_quota=True,user_id='155b99cd87234e69a375688e5fef68a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a11b6f23-c5e1-4885-af51-d6b515a3132b),volume_type_id=a11b6f23-c5e1-4885-af51-d6b515a3132b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50454946-5eb6-4bc1-a151-eacc8285fbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50454946-5eb6-4bc1-a151-eacc8285fbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95afc84-5cfe-4ece-bb51-d932bd95a03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95afc84-5cfe-4ece-bb51-d932bd95a03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a72515-d309-4a9e-a142-985e956295d2', 'volume_name': 'volume-b7a72515-d309-4a9e-a142-985e956295d2', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b00994d0-f486-4ded-9443-5eeedec53723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b00994d0-f486-4ded-9443-5eeedec53723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c87c4ef-016f-4d04-8e1f-0526aafe8a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:30 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Volume b7a72515-d309-4a9e-a142-985e956295d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a72515-d309-4a9e-a142-985e956295d2', 'volume_size': 1} Sep 23 15:13:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9ee295cb-bb63-4bf5-98e8-8291b54354b0,created_at=2026-09-23T13:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1469108411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ee295cb-bb63-4bf5-98e8-8291b54354b0,host='devstack@QuobyteHD#QuobyteHD',id=b7a72515-d309-4a9e-a142-985e956295d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6417a03110574e56904e3066416b5cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:13:30Z,use_quota=True,user_id='155b99cd87234e69a375688e5fef68a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a11b6f23-c5e1-4885-af51-d6b515a3132b),volume_type_id=a11b6f23-c5e1-4885-af51-d6b515a3132b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:13:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Creating volume b7a72515-d309-4a9e-a142-985e956295d2 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:13:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:13:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:13:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:13:30 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:13:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:30 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2 1073741824 Sep 23 15:13:30 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:31 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2 1073741824" returned: 0 in 0.856s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:13:31 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2 Sep 23 15:13:31 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Flow 'volume_create_manager' (a1c30449-9b50-4d21-a22d-6edfbbc699ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f7e4a0-e326-4929-ae44-35575f735514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f7e4a0-e326-4929-ae44-35575f735514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-239924600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48cd642c-37b4-4fe3-913d-757d9cc1617c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='69c0a8089a4e4d85a67357adc5e38c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d5fcae56-1ae5-4763-949d-943f94b69b54,status='creating',terminated_at=None,updated_at=2026-09-23T13:13:31Z,use_quota=True,user_id='df3159505d304665930ae644bb17d08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0643f0-b63b-4df6-b777-1c21731395cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0643f0-b63b-4df6-b777-1c21731395cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ffb996-8582-4db0-bf3f-51022bbf4934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ffb996-8582-4db0-bf3f-51022bbf4934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '48cd642c-37b4-4fe3-913d-757d9cc1617c', 'volume_name': 'volume-48cd642c-37b4-4fe3-913d-757d9cc1617c', 'volume_size': 1, 'source_volid': 'd5fcae56-1ae5-4763-949d-943f94b69b54', 'source_volstatus': 'available'}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccce297b-a5df-4626-ad47-07e5eac23c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccce297b-a5df-4626-ad47-07e5eac23c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122dc791-590f-4f78-8736-19c2d88d0d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:31 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Volume 48cd642c-37b4-4fe3-913d-757d9cc1617c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-48cd642c-37b4-4fe3-913d-757d9cc1617c', 'volume_size': 1, 'source_volid': 'd5fcae56-1ae5-4763-949d-943f94b69b54', 'source_volstatus': 'available'} Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:31 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2" returned: 0 in 0.341s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.155s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:31 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Cloning volume d5fcae56-1ae5-4763-949d-943f94b69b54 to volume 48cd642c-37b4-4fe3-913d-757d9cc1617c Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c87c4ef-016f-4d04-8e1f-0526aafe8a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a72515-d309-4a9e-a142-985e956295d2', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca273784-9bd8-4445-8da3-4e2fd47a1553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Creating offline snapshot 28be1571-3e72-459c-94d7-5681ed429454 of volume d5fcae56-1ae5-4763-949d-943f94b69b54 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:13:31 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Volume volume-b7a72515-d309-4a9e-a142-985e956295d2 (b7a72515-d309-4a9e-a142-985e956295d2): created successfully Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca273784-9bd8-4445-8da3-4e2fd47a1553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Flow 'volume_create_manager' (859c3b5e-18d2-40eb-883c-45c07b3ae237) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:13:31 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-b1d846b2-7421-4524-97d3-9d0a692a6078 tempest-GroupSnapshotsTest-23436513 None] Created volume successfully. Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab05866-7fd6-4af4-9bef-ce9e8a1b7112]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:31 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54 Sep 23 15:13:31 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:32 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54" returned: 0 in 0.438s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:32 devstack sudo[95365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454 1G Sep 23 15:13:32 devstack sudo[95365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:32 devstack sudo[95365]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454 1G" returned: 0 in 0.491s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5fcae56-1ae5-4763-949d-943f94b69b54 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:32 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5fcae56-1ae5-4763-949d-943f94b69b54 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454 Sep 23 15:13:32 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:33 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-de141313-735f-4e0d-b1f0-ebd6deb01b4b tempest-GroupSnapshotsTest-23436513 None] Update group completed successfully. Sep 23 15:13:33 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5fcae56-1ae5-4763-949d-943f94b69b54 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454" returned: 0 in 0.484s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:33 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454 is being set with open permissions: ugo+rw Sep 23 15:13:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:33 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454 Sep 23 15:13:33 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:33 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454" returned: 0 in 0.316s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:33 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.info Sep 23 15:13:33 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:33 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.info" returned: 0 in 0.281s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:33 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.info is being set with open permissions: ugo+rw Sep 23 15:13:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:33 devstack sudo[95382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.info Sep 23 15:13:33 devstack sudo[95382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:34 devstack sudo[95382]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.info" returned: 0 in 0.274s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:34 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Acquiring lock "cinder-quobyte-48cd642c-37b4-4fe3-913d-757d9cc1617c" by "_copy_volume_from_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:34 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Lock "cinder-quobyte-48cd642c-37b4-4fe3-913d-757d9cc1617c" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] snapshot: 28be1571-3e72-459c-94d7-5681ed429454, volume: 48cd642c-37b4-4fe3-913d-757d9cc1617c, {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 15:13:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:13:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:13:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:34 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9c52ea-a7fe-4e7c-a088-1722c7939dd6]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:34 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-50675c94-e256-4fb2-b504-5d75fc701f4a tempest-GroupSnapshotsTest-23436513 None] Update group completed successfully. Sep 23 15:13:34 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454 Sep 23 15:13:34 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:34 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454" returned: 0 in 0.556s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5fcae56-1ae5-4763-949d-943f94b69b54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:13:34 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc87f91c-4826-4fc2-8034-4d68a25912be]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:35 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54 Sep 23 15:13:35 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:35 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54" returned: 0 in 0.458s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54 {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 15:13:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Creating direct copy from snapshot {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 15:13:35 devstack cinder-volume[86064]: DEBUG cinder.utils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Path /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-48cd642c-37b4-4fe3-913d-757d9cc1617c not found in is_blk_device check {{(pid=86064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 15:13:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-48cd642c-37b4-4fe3-913d-757d9cc1617c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:35 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-48cd642c-37b4-4fe3-913d-757d9cc1617c Sep 23 15:13:35 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:35 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-682031d3-fd7f-434e-a4b4-dd0293b7f395 tempest-GroupSnapshotsTest-23436513 None] Update group completed successfully. Sep 23 15:13:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:13:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:13:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:13:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:36 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:13:36 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:36 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.689s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:13:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:13:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 28 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:13:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:13:37 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-35e5a5e3-0cd2-4488-99a0-e83964f377c9 tempest-GroupSnapshotsTest-23436513 None] Update group completed successfully. Sep 23 15:13:39 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] GroupSnapshot d8c07cf3-fc03-41e5-905e-a1f28be8e315: creating. Sep 23 15:13:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] Group snapshot d8c07cf3-fc03-41e5-905e-a1f28be8e315: creating. {{(pid=86064) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 15:13:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:45 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-48cd642c-37b4-4fe3-913d-757d9cc1617c" returned: 0 in 10.407s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:45 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54, size 1024.00 MB, duration 10.41 sec, destination /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-48cd642c-37b4-4fe3-913d-757d9cc1617c {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:13:45 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Converted 1024.00 MB image at 98.39 MB/s Sep 23 15:13:45 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-48cd642c-37b4-4fe3-913d-757d9cc1617c is being set with open permissions: ugo+rw Sep 23 15:13:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-48cd642c-37b4-4fe3-913d-757d9cc1617c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:45 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-48cd642c-37b4-4fe3-913d-757d9cc1617c Sep 23 15:13:45 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:46 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-48cd642c-37b4-4fe3-913d-757d9cc1617c" returned: 0 in 0.376s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Lock "cinder-quobyte-48cd642c-37b4-4fe3-913d-757d9cc1617c" released by "_copy_volume_from_snapshot" :: held 11.907s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:13:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Acquiring lock "cinder-quobyte-28be1571-3e72-459c-94d7-5681ed429454" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Lock "cinder-quobyte-28be1571-3e72-459c-94d7-5681ed429454" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Deleting offline snapshot 28be1571-3e72-459c-94d7-5681ed429454 of volume d5fcae56-1ae5-4763-949d-943f94b69b54 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:13:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] snapshot_file for this snap is: volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:13:46 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cef494-11f0-494a-8191-6a266bb21ba0]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:46 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454 Sep 23 15:13:46 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:46 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454" returned: 0 in 0.435s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5fcae56-1ae5-4763-949d-943f94b69b54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:13:46 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[976adabe-01f3-4f0e-8c90-46429eb86248]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:46 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54 Sep 23 15:13:46 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:47 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54" returned: 0 in 0.617s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:47 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454 Sep 23 15:13:47 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:47 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454" returned: 0 in 0.600s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:47 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454 Sep 23 15:13:47 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:48 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54.28be1571-3e72-459c-94d7-5681ed429454" returned: 0 in 0.610s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:48 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Lock "cinder-quobyte-28be1571-3e72-459c-94d7-5681ed429454" released by "_delete_snapshot" :: held 2.407s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:13:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.919s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.299s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] Creating offline snapshot 3fb46a47-675c-4818-8c18-316257a1f209 of volume b7a72515-d309-4a9e-a142-985e956295d2 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:13:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122dc791-590f-4f78-8736-19c2d88d0d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48cd642c-37b4-4fe3-913d-757d9cc1617c', 'volume_size': 1, 'source_volid': 'd5fcae56-1ae5-4763-949d-943f94b69b54', 'source_volstatus': 'available'}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee16f35-a1a6-4a49-ab04-9edfef3951b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:48 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8712c692-437f-4601-8cfd-0d3e26359c1c]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:48 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Volume volume-48cd642c-37b4-4fe3-913d-757d9cc1617c (48cd642c-37b4-4fe3-913d-757d9cc1617c): created successfully Sep 23 15:13:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee16f35-a1a6-4a49-ab04-9edfef3951b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Flow 'volume_create_manager' (a1c30449-9b50-4d21-a22d-6edfbbc699ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:13:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:48 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-b508fbb1-c087-4f37-9068-4741a2ea9104 tempest-VolumesGetTest-1118423804 None] Created volume successfully. Sep 23 15:13:48 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2 Sep 23 15:13:48 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:49 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2" returned: 0 in 0.632s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.3fb46a47-675c-4818-8c18-316257a1f209 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:49 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.3fb46a47-675c-4818-8c18-316257a1f209 1G Sep 23 15:13:49 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:50 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.3fb46a47-675c-4818-8c18-316257a1f209 1G" returned: 0 in 1.211s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7a72515-d309-4a9e-a142-985e956295d2 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.3fb46a47-675c-4818-8c18-316257a1f209 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:50 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7a72515-d309-4a9e-a142-985e956295d2 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.3fb46a47-675c-4818-8c18-316257a1f209 Sep 23 15:13:50 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:51 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7a72515-d309-4a9e-a142-985e956295d2 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.3fb46a47-675c-4818-8c18-316257a1f209" returned: 0 in 0.645s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:51 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.3fb46a47-675c-4818-8c18-316257a1f209 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 15:13:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.3fb46a47-675c-4818-8c18-316257a1f209 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:51 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.3fb46a47-675c-4818-8c18-316257a1f209 Sep 23 15:13:51 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:51 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:13:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Flow 'volume_create_manager' (578e0a55-d25a-4fcf-9c1d-99b8ad8c9c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:13:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29ef7b0-f486-4406-80d1-a31ab38e9227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29ef7b0-f486-4406-80d1-a31ab38e9227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:13:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1422085911',display_name='tempest-VolumesGetTest-Volume-36249366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=415fa61b-128e-4887-9f98-3293ae116c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c0a8089a4e4d85a67357adc5e38c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:13:51Z,use_quota=True,user_id='df3159505d304665930ae644bb17d08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481fab7b-abc8-4be1-a8d2-1d25b220e020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481fab7b-abc8-4be1-a8d2-1d25b220e020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84c8fbbf-9f3b-4d0c-bf11-290d34177c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84c8fbbf-9f3b-4d0c-bf11-290d34177c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '415fa61b-128e-4887-9f98-3293ae116c5e', 'volume_name': 'volume-415fa61b-128e-4887-9f98-3293ae116c5e', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb87f291-806a-410e-be12-b375dc4527c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb87f291-806a-410e-be12-b375dc4527c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e8f157-76c3-465b-89d4-a4f258f4a10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:51 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Volume 415fa61b-128e-4887-9f98-3293ae116c5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-415fa61b-128e-4887-9f98-3293ae116c5e', 'volume_size': 1} Sep 23 15:13:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:51 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.3fb46a47-675c-4818-8c18-316257a1f209" returned: 0 in 0.389s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:51 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.info Sep 23 15:13:51 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:52 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.info" returned: 0 in 0.447s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:52 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 15:13:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:52 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.info Sep 23 15:13:52 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:52 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.info" returned: 0 in 0.262s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.757s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] Creating offline snapshot f0c37e16-8630-4ffa-9fb5-31f7a54bda17 of volume e00990f2-56ae-45e2-abb2-82f64093f3db {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:13:52 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9976fa1-3bfb-425d-a849-c2dd3afac629]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:52 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db Sep 23 15:13:52 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:53 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db" returned: 0 in 0.682s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.f0c37e16-8630-4ffa-9fb5-31f7a54bda17 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:53 devstack sudo[95648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.f0c37e16-8630-4ffa-9fb5-31f7a54bda17 1G Sep 23 15:13:53 devstack sudo[95648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:53 devstack sudo[95648]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.f0c37e16-8630-4ffa-9fb5-31f7a54bda17 1G" returned: 0 in 0.542s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e00990f2-56ae-45e2-abb2-82f64093f3db -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.f0c37e16-8630-4ffa-9fb5-31f7a54bda17 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:53 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e00990f2-56ae-45e2-abb2-82f64093f3db -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.f0c37e16-8630-4ffa-9fb5-31f7a54bda17 Sep 23 15:13:53 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:54 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e00990f2-56ae-45e2-abb2-82f64093f3db -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.f0c37e16-8630-4ffa-9fb5-31f7a54bda17" returned: 0 in 0.347s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:54 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.f0c37e16-8630-4ffa-9fb5-31f7a54bda17 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 15:13:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.f0c37e16-8630-4ffa-9fb5-31f7a54bda17 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:54 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.f0c37e16-8630-4ffa-9fb5-31f7a54bda17 Sep 23 15:13:54 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:54 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.f0c37e16-8630-4ffa-9fb5-31f7a54bda17" returned: 0 in 0.287s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:54 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.info Sep 23 15:13:54 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:54 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.info" returned: 0 in 0.379s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:54 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 15:13:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:54 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.info Sep 23 15:13:54 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:55 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.info" returned: 0 in 0.377s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.776s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.636s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:13:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1422085911',display_name='tempest-VolumesGetTest-Volume-36249366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=415fa61b-128e-4887-9f98-3293ae116c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c0a8089a4e4d85a67357adc5e38c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:13:51Z,use_quota=True,user_id='df3159505d304665930ae644bb17d08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:13:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Creating volume 415fa61b-128e-4887-9f98-3293ae116c5e {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:13:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:13:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:13:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:13:55 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:13:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-415fa61b-128e-4887-9f98-3293ae116c5e 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:55 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-415fa61b-128e-4887-9f98-3293ae116c5e 1073741824 Sep 23 15:13:55 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:55 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7cf1355e-c749-44bb-bc86-e74d7ac63e67 tempest-GroupSnapshotsTest-23436513 None] group_snapshot d8c07cf3-fc03-41e5-905e-a1f28be8e315: created successfully Sep 23 15:13:56 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-415fa61b-128e-4887-9f98-3293ae116c5e 1073741824" returned: 0 in 0.792s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-415fa61b-128e-4887-9f98-3293ae116c5e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:56 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-415fa61b-128e-4887-9f98-3293ae116c5e Sep 23 15:13:56 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:56 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] group_snapshot d8c07cf3-fc03-41e5-905e-a1f28be8e315: deleting Sep 23 15:13:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] group_snapshot d8c07cf3-fc03-41e5-905e-a1f28be8e315: deleting {{(pid=86064) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 15:13:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "cinder-quobyte-b7a72515-d309-4a9e-a142-985e956295d2" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:56 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-415fa61b-128e-4887-9f98-3293ae116c5e" returned: 0 in 0.527s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:13:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-b7a72515-d309-4a9e-a142-985e956295d2" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "cinder-quobyte-3fb46a47-675c-4818-8c18-316257a1f209" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e8f157-76c3-465b-89d4-a4f258f4a10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-415fa61b-128e-4887-9f98-3293ae116c5e', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4469116-5d71-4936-b387-231a749856ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:13:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-3fb46a47-675c-4818-8c18-316257a1f209" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Deleting offline snapshot 3fb46a47-675c-4818-8c18-316257a1f209 of volume b7a72515-d309-4a9e-a142-985e956295d2 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:13:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] snapshot_file for this snap is: volume-b7a72515-d309-4a9e-a142-985e956295d2.3fb46a47-675c-4818-8c18-316257a1f209 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:13:56 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Volume volume-415fa61b-128e-4887-9f98-3293ae116c5e (415fa61b-128e-4887-9f98-3293ae116c5e): created successfully Sep 23 15:13:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4469116-5d71-4936-b387-231a749856ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:13:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Flow 'volume_create_manager' (578e0a55-d25a-4fcf-9c1d-99b8ad8c9c64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:13:56 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ab6b6c-6c3f-4a1c-8e11-923b7707d437]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.3fb46a47-675c-4818-8c18-316257a1f209 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:56 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-da0f9108-7050-4eb0-875d-01da2a0c93e2 tempest-VolumesGetTest-1118423804 None] Created volume successfully. Sep 23 15:13:56 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.3fb46a47-675c-4818-8c18-316257a1f209 Sep 23 15:13:56 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:57 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.3fb46a47-675c-4818-8c18-316257a1f209" returned: 0 in 0.514s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7a72515-d309-4a9e-a142-985e956295d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:13:57 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[17950328-82de-483c-a9ee-830ced007ed6]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:57 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2 Sep 23 15:13:57 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:57 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2" returned: 0 in 0.436s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.3fb46a47-675c-4818-8c18-316257a1f209 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:57 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.3fb46a47-675c-4818-8c18-316257a1f209 Sep 23 15:13:57 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e2549ace-f8dd-4687-ae33-ab4bcb9dcd18 tempest-VolumesGetTest-1118423804 None] Acquiring lock "cinder-415fa61b-128e-4887-9f98-3293ae116c5e-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e2549ace-f8dd-4687-ae33-ab4bcb9dcd18 tempest-VolumesGetTest-1118423804 None] Lock "cinder-415fa61b-128e-4887-9f98-3293ae116c5e-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e2549ace-f8dd-4687-ae33-ab4bcb9dcd18 tempest-VolumesGetTest-1118423804 None] Acquiring lock "cinder-quobyte-415fa61b-128e-4887-9f98-3293ae116c5e" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e2549ace-f8dd-4687-ae33-ab4bcb9dcd18 tempest-VolumesGetTest-1118423804 None] Lock "cinder-quobyte-415fa61b-128e-4887-9f98-3293ae116c5e" acquired by "delete_volume" :: waited 0.026s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:58 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1309a0e-4b75-40fb-a5d7-b649b0e8275e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e2549ace-f8dd-4687-ae33-ab4bcb9dcd18 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-415fa61b-128e-4887-9f98-3293ae116c5e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:58 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.3fb46a47-675c-4818-8c18-316257a1f209" returned: 0 in 0.662s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.3fb46a47-675c-4818-8c18-316257a1f209 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:58 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.3fb46a47-675c-4818-8c18-316257a1f209 Sep 23 15:13:58 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:58 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-415fa61b-128e-4887-9f98-3293ae116c5e Sep 23 15:13:58 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:58 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2.3fb46a47-675c-4818-8c18-316257a1f209" returned: 0 in 0.303s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-3fb46a47-675c-4818-8c18-316257a1f209" released by "_delete_snapshot" :: held 2.111s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:13:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-b7a72515-d309-4a9e-a142-985e956295d2" released by "delete_snapshot" :: held 2.188s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:13:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "cinder-quobyte-e00990f2-56ae-45e2-abb2-82f64093f3db" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-e00990f2-56ae-45e2-abb2-82f64093f3db" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "cinder-quobyte-f0c37e16-8630-4ffa-9fb5-31f7a54bda17" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:13:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-f0c37e16-8630-4ffa-9fb5-31f7a54bda17" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:13:58 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Deleting offline snapshot f0c37e16-8630-4ffa-9fb5-31f7a54bda17 of volume e00990f2-56ae-45e2-abb2-82f64093f3db {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:13:58 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] snapshot_file for this snap is: volume-e00990f2-56ae-45e2-abb2-82f64093f3db.f0c37e16-8630-4ffa-9fb5-31f7a54bda17 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:13:59 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2db4eec-9c40-40fd-a242-d657c740aca7]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.f0c37e16-8630-4ffa-9fb5-31f7a54bda17 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:59 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e2549ace-f8dd-4687-ae33-ab4bcb9dcd18 tempest-VolumesGetTest-1118423804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-415fa61b-128e-4887-9f98-3293ae116c5e" returned: 0 in 0.672s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e2549ace-f8dd-4687-ae33-ab4bcb9dcd18 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-415fa61b-128e-4887-9f98-3293ae116c5e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:59 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-415fa61b-128e-4887-9f98-3293ae116c5e Sep 23 15:13:59 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:59 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.f0c37e16-8630-4ffa-9fb5-31f7a54bda17 Sep 23 15:13:59 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:59 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e2549ace-f8dd-4687-ae33-ab4bcb9dcd18 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-415fa61b-128e-4887-9f98-3293ae116c5e" returned: 0 in 0.386s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e2549ace-f8dd-4687-ae33-ab4bcb9dcd18 tempest-VolumesGetTest-1118423804 None] Lock "cinder-quobyte-415fa61b-128e-4887-9f98-3293ae116c5e" released by "delete_volume" :: held 1.124s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:13:59 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-e2549ace-f8dd-4687-ae33-ab4bcb9dcd18 tempest-VolumesGetTest-1118423804 None] Created reservations ['f25fa520-54eb-476e-83b6-03569725c559', '9063ffcd-fdb4-4e83-a9c0-a9899ed72d02', '875a7693-c19b-446b-ac4e-f9d304238a86', 'f3c14d43-e9e3-412b-8734-50c56864d4d7'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:13:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e2549ace-f8dd-4687-ae33-ab4bcb9dcd18 tempest-VolumesGetTest-1118423804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:13:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e2549ace-f8dd-4687-ae33-ab4bcb9dcd18 tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:13:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e2549ace-f8dd-4687-ae33-ab4bcb9dcd18 tempest-VolumesGetTest-1118423804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:13:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e2549ace-f8dd-4687-ae33-ab4bcb9dcd18 tempest-VolumesGetTest-1118423804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:13:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e2549ace-f8dd-4687-ae33-ab4bcb9dcd18 tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:13:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e2549ace-f8dd-4687-ae33-ab4bcb9dcd18 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:13:59 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:13:59 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:13:59 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Sep 23 15:13:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.f0c37e16-8630-4ffa-9fb5-31f7a54bda17" returned: 0 in 0.780s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:13:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e00990f2-56ae-45e2-abb2-82f64093f3db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:13:59 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35eb55b-5429-450c-81b1-6cbbc5feb7fb]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:13:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:00 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e2549ace-f8dd-4687-ae33-ab4bcb9dcd18 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.414s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:00 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-e2549ace-f8dd-4687-ae33-ab4bcb9dcd18 tempest-VolumesGetTest-1118423804 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:14:00 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-e2549ace-f8dd-4687-ae33-ab4bcb9dcd18 tempest-VolumesGetTest-1118423804 None] Deleted volume successfully. Sep 23 15:14:00 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db Sep 23 15:14:00 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:00 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e2549ace-f8dd-4687-ae33-ab4bcb9dcd18 tempest-VolumesGetTest-1118423804 None] Lock "cinder-415fa61b-128e-4887-9f98-3293ae116c5e-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:14:00 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db" returned: 0 in 0.574s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.f0c37e16-8630-4ffa-9fb5-31f7a54bda17 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:00 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.f0c37e16-8630-4ffa-9fb5-31f7a54bda17 Sep 23 15:14:00 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:00 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5123d34c-6232-4ec9-8df7-798ee1a71a69 tempest-VolumesGetTest-1118423804 None] Acquiring lock "cinder-48cd642c-37b4-4fe3-913d-757d9cc1617c-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:14:00 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5123d34c-6232-4ec9-8df7-798ee1a71a69 tempest-VolumesGetTest-1118423804 None] Lock "cinder-48cd642c-37b4-4fe3-913d-757d9cc1617c-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:14:00 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5123d34c-6232-4ec9-8df7-798ee1a71a69 tempest-VolumesGetTest-1118423804 None] Acquiring lock "cinder-quobyte-48cd642c-37b4-4fe3-913d-757d9cc1617c" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:14:00 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5123d34c-6232-4ec9-8df7-798ee1a71a69 tempest-VolumesGetTest-1118423804 None] Lock "cinder-quobyte-48cd642c-37b4-4fe3-913d-757d9cc1617c" acquired by "delete_volume" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:14:00 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c66804-2e48-4804-98d7-a3f35c5a5067]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:14:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5123d34c-6232-4ec9-8df7-798ee1a71a69 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-48cd642c-37b4-4fe3-913d-757d9cc1617c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:01 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-48cd642c-37b4-4fe3-913d-757d9cc1617c Sep 23 15:14:01 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:01 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.f0c37e16-8630-4ffa-9fb5-31f7a54bda17" returned: 0 in 0.756s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.f0c37e16-8630-4ffa-9fb5-31f7a54bda17 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:14:01 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.f0c37e16-8630-4ffa-9fb5-31f7a54bda17 Sep 23 15:14:01 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Flow 'volume_create_manager' (15983134-bb9f-4e4f-8fbb-ee0006515750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5459a574-58ab-46ac-af41-f1baecb3919d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5459a574-58ab-46ac-af41-f1baecb3919d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1668476604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce65f047-101c-4324-9db2-dd0132144bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a72def9aa11142d39c660a9d7996264a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:14:01Z,use_quota=True,user_id='fa7499e0fccb4bc898b58764ec9c1669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3cc4a64-d90d-4bbd-9ceb-d34b3e57b5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3cc4a64-d90d-4bbd-9ceb-d34b3e57b5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (361aae90-b152-4cf3-8781-a3306b7d558e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (361aae90-b152-4cf3-8781-a3306b7d558e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce65f047-101c-4324-9db2-dd0132144bcd', 'volume_name': 'volume-ce65f047-101c-4324-9db2-dd0132144bcd', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090b0979-c220-483f-ae47-479b2bec96a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090b0979-c220-483f-ae47-479b2bec96a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59dd855b-3ab7-45a4-bea3-5f474ecdf8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:01 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Volume ce65f047-101c-4324-9db2-dd0132144bcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce65f047-101c-4324-9db2-dd0132144bcd', 'volume_size': 1} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1668476604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce65f047-101c-4324-9db2-dd0132144bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a72def9aa11142d39c660a9d7996264a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:14:01Z,use_quota=True,user_id='fa7499e0fccb4bc898b58764ec9c1669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Creating volume ce65f047-101c-4324-9db2-dd0132144bcd {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:14:01 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce65f047-101c-4324-9db2-dd0132144bcd 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:01 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce65f047-101c-4324-9db2-dd0132144bcd 1073741824 Sep 23 15:14:01 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:01 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5123d34c-6232-4ec9-8df7-798ee1a71a69 tempest-VolumesGetTest-1118423804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-48cd642c-37b4-4fe3-913d-757d9cc1617c" returned: 0 in 0.644s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5123d34c-6232-4ec9-8df7-798ee1a71a69 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-48cd642c-37b4-4fe3-913d-757d9cc1617c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:01 devstack sudo[95771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-48cd642c-37b4-4fe3-913d-757d9cc1617c Sep 23 15:14:01 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:01 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db.f0c37e16-8630-4ffa-9fb5-31f7a54bda17" returned: 0 in 0.553s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-f0c37e16-8630-4ffa-9fb5-31f7a54bda17" released by "_delete_snapshot" :: held 2.867s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-e00990f2-56ae-45e2-abb2-82f64093f3db" released by "delete_snapshot" :: held 2.914s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:14:01 devstack cinder-volume[86064]: WARNING cinder.quota [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-614208414 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-614208414, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:14:01 devstack cinder-volume[86064]: WARNING cinder.quota [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-614208414 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-614208414, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:14:01 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Created reservations ['927b66b8-897d-45d3-bd32-752792c9ee53', '39dfb66a-132a-4319-b55a-4b5024479a9f', '2ecb12f0-6bc5-46c9-998b-3eb4ffd53624', '65de4059-42ae-4132-bbc2-74c7ca69eeb8'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:14:02 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5123d34c-6232-4ec9-8df7-798ee1a71a69 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-48cd642c-37b4-4fe3-913d-757d9cc1617c" returned: 0 in 0.519s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:02 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5123d34c-6232-4ec9-8df7-798ee1a71a69 tempest-VolumesGetTest-1118423804 None] Lock "cinder-quobyte-48cd642c-37b4-4fe3-913d-757d9cc1617c" released by "delete_volume" :: held 1.245s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:14:02 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] Created reservations ['87081415-eae7-448e-ae18-af58b2667e51', 'c1dadc42-a885-4bab-bdd1-a67badd59356', '02644849-fabd-4006-a95d-8172c661036b', '18372e11-0834-46f6-81da-ed0505eaf469'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:14:02 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-5123d34c-6232-4ec9-8df7-798ee1a71a69 tempest-VolumesGetTest-1118423804 None] Created reservations ['32e7e33d-db98-4d3a-9ce3-bc14be0c1e05', 'd94499a6-2b0e-4739-a2a6-a45296f5802e', 'aad565b5-c4e0-423f-a080-401ca24e6dfb', 'dd4b8f66-e7b8-4462-88f5-6a3fa32857fb'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:14:02 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce65f047-101c-4324-9db2-dd0132144bcd 1073741824" returned: 0 in 0.811s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:02 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-1d6126c7-cd9f-4a39-a74f-55f06dde7f91 tempest-GroupSnapshotsTest-23436513 None] group_snapshot d8c07cf3-fc03-41e5-905e-a1f28be8e315: deleted successfully Sep 23 15:14:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5123d34c-6232-4ec9-8df7-798ee1a71a69 tempest-VolumesGetTest-1118423804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:14:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5123d34c-6232-4ec9-8df7-798ee1a71a69 tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:14:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5123d34c-6232-4ec9-8df7-798ee1a71a69 tempest-VolumesGetTest-1118423804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:14:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5123d34c-6232-4ec9-8df7-798ee1a71a69 tempest-VolumesGetTest-1118423804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:14:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5123d34c-6232-4ec9-8df7-798ee1a71a69 tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:14:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5123d34c-6232-4ec9-8df7-798ee1a71a69 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce65f047-101c-4324-9db2-dd0132144bcd {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:02 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:14:02 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:02 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce65f047-101c-4324-9db2-dd0132144bcd Sep 23 15:14:02 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:02 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5123d34c-6232-4ec9-8df7-798ee1a71a69 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.339s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:02 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-5123d34c-6232-4ec9-8df7-798ee1a71a69 tempest-VolumesGetTest-1118423804 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:14:02 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5123d34c-6232-4ec9-8df7-798ee1a71a69 tempest-VolumesGetTest-1118423804 None] Deleted volume successfully. Sep 23 15:14:02 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce65f047-101c-4324-9db2-dd0132144bcd" returned: 0 in 0.350s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:14:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:14:02 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5123d34c-6232-4ec9-8df7-798ee1a71a69 tempest-VolumesGetTest-1118423804 None] Lock "cinder-48cd642c-37b4-4fe3-913d-757d9cc1617c-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:14:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59dd855b-3ab7-45a4-bea3-5f474ecdf8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce65f047-101c-4324-9db2-dd0132144bcd', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d488768-371f-48b6-9871-f4f0feacb654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:02 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Volume volume-ce65f047-101c-4324-9db2-dd0132144bcd (ce65f047-101c-4324-9db2-dd0132144bcd): created successfully Sep 23 15:14:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d488768-371f-48b6-9871-f4f0feacb654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Flow 'volume_create_manager' (15983134-bb9f-4e4f-8fbb-ee0006515750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:14:02 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-30efb6d2-7b2e-4c25-ac61-574c39f87a94 tempest-ServerRescueNegativeTestJSON-709805673 None] Created volume successfully. Sep 23 15:14:03 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a7124612-4a36-4350-b9f7-89f4d2a0633f tempest-VolumesGetTest-1118423804 None] Acquiring lock "cinder-d5fcae56-1ae5-4763-949d-943f94b69b54-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:14:03 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a7124612-4a36-4350-b9f7-89f4d2a0633f tempest-VolumesGetTest-1118423804 None] Lock "cinder-d5fcae56-1ae5-4763-949d-943f94b69b54-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:14:03 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a7124612-4a36-4350-b9f7-89f4d2a0633f tempest-VolumesGetTest-1118423804 None] Acquiring lock "cinder-quobyte-d5fcae56-1ae5-4763-949d-943f94b69b54" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:14:03 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a7124612-4a36-4350-b9f7-89f4d2a0633f tempest-VolumesGetTest-1118423804 None] Lock "cinder-quobyte-d5fcae56-1ae5-4763-949d-943f94b69b54" acquired by "delete_volume" :: waited 0.031s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:14:03 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d300afff-72fd-49e2-a90a-2b8503acab4e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:14:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a7124612-4a36-4350-b9f7-89f4d2a0633f tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:03 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54 Sep 23 15:14:03 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:03 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "cinder-quobyte-b7a72515-d309-4a9e-a142-985e956295d2" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:14:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-b7a72515-d309-4a9e-a142-985e956295d2" acquired by "delete_volume" :: waited 0.021s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:14:04 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c03ee09-417d-459f-961f-f566e3a05531]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:14:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:04 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a7124612-4a36-4350-b9f7-89f4d2a0633f tempest-VolumesGetTest-1118423804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54" returned: 0 in 0.707s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a7124612-4a36-4350-b9f7-89f4d2a0633f tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:04 devstack sudo[95839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2 Sep 23 15:14:04 devstack sudo[95839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:04 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54 Sep 23 15:14:04 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:04 devstack sudo[95839]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2" returned: 0 in 0.499s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:04 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2 Sep 23 15:14:04 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:04 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a7124612-4a36-4350-b9f7-89f4d2a0633f tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5fcae56-1ae5-4763-949d-943f94b69b54" returned: 0 in 0.440s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a7124612-4a36-4350-b9f7-89f4d2a0633f tempest-VolumesGetTest-1118423804 None] Lock "cinder-quobyte-d5fcae56-1ae5-4763-949d-943f94b69b54" released by "delete_volume" :: held 1.269s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:14:04 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-a7124612-4a36-4350-b9f7-89f4d2a0633f tempest-VolumesGetTest-1118423804 None] Created reservations ['5e4cd706-0fd9-4138-aeae-c2ca1b04167f', '366fbb67-d881-45a4-a705-02176c46a8a7', '70db63ca-685c-406c-a51f-cdb5746e5a8c', 'f8697c35-ac22-4389-88cc-446a74eb50f9'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:14:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a7124612-4a36-4350-b9f7-89f4d2a0633f tempest-VolumesGetTest-1118423804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:14:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a7124612-4a36-4350-b9f7-89f4d2a0633f tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:14:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a7124612-4a36-4350-b9f7-89f4d2a0633f tempest-VolumesGetTest-1118423804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:14:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a7124612-4a36-4350-b9f7-89f4d2a0633f tempest-VolumesGetTest-1118423804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:14:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a7124612-4a36-4350-b9f7-89f4d2a0633f tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:14:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a7124612-4a36-4350-b9f7-89f4d2a0633f tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:04 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:14:04 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:04 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b7a72515-d309-4a9e-a142-985e956295d2" returned: 0 in 0.303s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-b7a72515-d309-4a9e-a142-985e956295d2" released by "delete_volume" :: held 0.900s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:14:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "cinder-quobyte-e00990f2-56ae-45e2-abb2-82f64093f3db" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:14:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-e00990f2-56ae-45e2-abb2-82f64093f3db" acquired by "delete_volume" :: waited 0.022s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:14:04 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[590290d0-1a1a-4eb2-8736-6394a441853c]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:14:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:05 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a7124612-4a36-4350-b9f7-89f4d2a0633f tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.368s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:05 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-a7124612-4a36-4350-b9f7-89f4d2a0633f tempest-VolumesGetTest-1118423804 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:14:05 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-a7124612-4a36-4350-b9f7-89f4d2a0633f tempest-VolumesGetTest-1118423804 None] Deleted volume successfully. Sep 23 15:14:05 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db Sep 23 15:14:05 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:05 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a7124612-4a36-4350-b9f7-89f4d2a0633f tempest-VolumesGetTest-1118423804 None] Lock "cinder-d5fcae56-1ae5-4763-949d-943f94b69b54-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:14:05 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db" returned: 0 in 0.658s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:05 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db Sep 23 15:14:05 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:06 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e00990f2-56ae-45e2-abb2-82f64093f3db" returned: 0 in 0.360s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-e00990f2-56ae-45e2-abb2-82f64093f3db" released by "delete_volume" :: held 1.117s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:14:06 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] Created reservations ['11d050fe-e6e0-4556-bbe6-d5a09b599826'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:14:06 devstack cinder-volume[86064]: WARNING cinder.quota [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-614208414 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-614208414, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:14:06 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] Created reservations ['9aadc27e-7be2-4935-aa04-258950980875', '60d6c123-264e-4248-b16e-947a7bb10096', '165af746-4ba3-4900-9ae5-a75f0531eeae', '1637b623-5938-43ea-b292-d76d096a69c8'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:14:06 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] Created reservations ['c8f5c9d9-00a2-4835-a660-a81ebf20121c', '9a70dd55-6df0-4706-a0f4-4d347c8c176e', '07f11eb5-7b82-4e8d-bb1d-815bc8f6acbb', '7460d149-b36c-495c-b84c-8e68bfe27be4'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:14:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:14:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:14:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:14:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:14:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:14:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:06 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:14:06 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:06 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:14:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Flow 'volume_create_manager' (8220c5a9-599b-4b35-bf08-78bc30ad5bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:14:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ae2b8f-2265-43b1-9f9e-fff2b2bce917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ae2b8f-2265-43b1-9f9e-fff2b2bce917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1318405564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3d4992-513c-491c-bccf-ee15b37e1a52,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='69c0a8089a4e4d85a67357adc5e38c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:14:07Z,use_quota=True,user_id='df3159505d304665930ae644bb17d08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8c9b41-adb7-410b-bb17-0dc88ef7a45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8c9b41-adb7-410b-bb17-0dc88ef7a45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e2ef297-cd8b-47fb-881f-11d2b4352958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:07 devstack cinder-volume[86064]: DEBUG cinder.image.glance [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Creating Keystone auth plugin from conf {{(pid=86064) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 15:14:07 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.613s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:07 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:14:07 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-2b168af0-e3fe-4937-9066-2a3464a1116c tempest-GroupSnapshotsTest-23436513 None] Delete group completed successfully. Sep 23 15:14:07 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-4b9c1707-4822-46a7-8648-c5c965c236c4 tempest-GroupSnapshotsTest-23436513 None] Group tempest-GroupSnapshotsTest-Group-393475862: creating Sep 23 15:14:07 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-4b9c1707-4822-46a7-8648-c5c965c236c4 tempest-GroupSnapshotsTest-23436513 None] Group tempest-GroupSnapshotsTest-Group-393475862: created successfully Sep 23 15:14:07 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-4b9c1707-4822-46a7-8648-c5c965c236c4 tempest-GroupSnapshotsTest-23436513 None] Create group completed successfully. Sep 23 15:14:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e2ef297-cd8b-47fb-881f-11d2b4352958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cd3d4992-513c-491c-bccf-ee15b37e1a52', 'volume_name': 'volume-cd3d4992-513c-491c-bccf-ee15b37e1a52', 'volume_size': 1, 'image_id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6096e44b8882450f8963b9e995032e95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'created_at': datetime.datetime(2026, 9, 23, 13, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e612db8e-4d33-469a-9b98-e7920f09b036/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e043b1-3fa0-4e6b-a5cc-3f61148c87d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e043b1-3fa0-4e6b-a5cc-3f61148c87d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc37037-b181-4541-825a-0c577efbd275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:08 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Volume cd3d4992-513c-491c-bccf-ee15b37e1a52: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cd3d4992-513c-491c-bccf-ee15b37e1a52', 'volume_size': 1, 'image_id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6096e44b8882450f8963b9e995032e95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'created_at': datetime.datetime(2026, 9, 23, 13, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e612db8e-4d33-469a-9b98-e7920f09b036/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 15:14:08 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Trying to clone cd3d4992-513c-491c-bccf-ee15b37e1a52 from image e612db8e-4d33-469a-9b98-e7920f09b036 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}]). {{(pid=86064) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 15:14:09 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036___9mtbgydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 15:14:09 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Image download 20.69 MB at 20.69 MB/s Sep 23 15:14:09 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-ab3b0e28-474b-4b72-ac58-24e1cc6ae79e req-0bac8bc8-11c3-47ee-a831-0e5ebe0cb7af tempest-AttachVolumeTestJSON-1693410156 None] Terminate volume connection completed successfully. Sep 23 15:14:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-ab3b0e28-474b-4b72-ac58-24e1cc6ae79e req-0bac8bc8-11c3-47ee-a831-0e5ebe0cb7af tempest-AttachVolumeTestJSON-1693410156 None] Deleting attachment 051bde8d-70e9-4b00-aa3d-68d442a1fb14. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:14:09 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[37001345-c225-42e4-af7d-65bc9c7bf2d2]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:14:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036___9mtbgydevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:09 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036___9mtbgydevstack@QuobyteHD Sep 23 15:14:09 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:10 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036___9mtbgydevstack@QuobyteHD" returned: 0 in 0.874s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:10 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Temporary image e612db8e-4d33-469a-9b98-e7920f09b036 is fetched for user df3159505d304665930ae644bb17d08a. {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 15:14:10 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89ae1d1-7cef-421e-8442-a253ceb51dda]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:14:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036___9mtbgydevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:10 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036___9mtbgydevstack@QuobyteHD Sep 23 15:14:10 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:10 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Flow 'volume_create_manager' (eb7170f2-6520-425b-b5e4-874635759c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3393abbf-38d0-41ab-8e8a-22cc864f24fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:11 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3393abbf-38d0-41ab-8e8a-22cc864f24fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-470034351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e2d4709-3573-413c-b4d7-89e3aa2d20d2,host='devstack@QuobyteHD#QuobyteHD',id=0dac9f07-ac67-424a-b686-909648487dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6417a03110574e56904e3066416b5cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:14:11Z,use_quota=True,user_id='155b99cd87234e69a375688e5fef68a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea7f58f4-762a-44b9-84eb-bbd087541695),volume_type_id=ea7f58f4-762a-44b9-84eb-bbd087541695)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ad8e32-0d1e-47a7-8948-3e588df7954c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ad8e32-0d1e-47a7-8948-3e588df7954c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a83939-29bd-49db-817f-06606f4296d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a83939-29bd-49db-817f-06606f4296d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dac9f07-ac67-424a-b686-909648487dc0', 'volume_name': 'volume-0dac9f07-ac67-424a-b686-909648487dc0', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380e5d8f-34ab-475e-a73f-b01d7b8a098b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380e5d8f-34ab-475e-a73f-b01d7b8a098b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db345cd-9da1-494f-be59-0d1be42528af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:11 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Volume 0dac9f07-ac67-424a-b686-909648487dc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dac9f07-ac67-424a-b686-909648487dc0', 'volume_size': 1} Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6e2d4709-3573-413c-b4d7-89e3aa2d20d2,created_at=2026-09-23T13:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-470034351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e2d4709-3573-413c-b4d7-89e3aa2d20d2,host='devstack@QuobyteHD#QuobyteHD',id=0dac9f07-ac67-424a-b686-909648487dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6417a03110574e56904e3066416b5cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:14:11Z,use_quota=True,user_id='155b99cd87234e69a375688e5fef68a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea7f58f4-762a-44b9-84eb-bbd087541695),volume_type_id=ea7f58f4-762a-44b9-84eb-bbd087541695)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Creating volume 0dac9f07-ac67-424a-b686-909648487dc0 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:14:11 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036___9mtbgydevstack@QuobyteHD" returned: 0 in 1.106s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:14:11 devstack sudo[95943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0 1073741824 Sep 23 15:14:11 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:12 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0 1073741824" returned: 0 in 0.637s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:12 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0 Sep 23 15:14:12 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:12 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0" returned: 0 in 0.322s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:14:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:14:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.004s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:14:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1318405564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3d4992-513c-491c-bccf-ee15b37e1a52,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='69c0a8089a4e4d85a67357adc5e38c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:14:07Z,use_quota=True,user_id='df3159505d304665930ae644bb17d08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:14:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Creating volume cd3d4992-513c-491c-bccf-ee15b37e1a52 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:14:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:14:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:14:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:14:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:14:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:14:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:14:12 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:14:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd3d4992-513c-491c-bccf-ee15b37e1a52 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:12 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd3d4992-513c-491c-bccf-ee15b37e1a52 1073741824 Sep 23 15:14:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db345cd-9da1-494f-be59-0d1be42528af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dac9f07-ac67-424a-b686-909648487dc0', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:12 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bff56db-7263-4304-a722-e1fd1ac11525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:12 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Volume volume-0dac9f07-ac67-424a-b686-909648487dc0 (0dac9f07-ac67-424a-b686-909648487dc0): created successfully Sep 23 15:14:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bff56db-7263-4304-a722-e1fd1ac11525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Flow 'volume_create_manager' (eb7170f2-6520-425b-b5e4-874635759c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:14:12 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-4bf6b587-34f0-4102-ba40-0a564e08cfce tempest-GroupSnapshotsTest-23436513 None] Created volume successfully. Sep 23 15:14:13 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd3d4992-513c-491c-bccf-ee15b37e1a52 1073741824" returned: 0 in 0.873s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd3d4992-513c-491c-bccf-ee15b37e1a52 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:13 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd3d4992-513c-491c-bccf-ee15b37e1a52 Sep 23 15:14:13 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:14 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd3d4992-513c-491c-bccf-ee15b37e1a52" returned: 0 in 0.789s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:14:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:14:14 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Attempting download of e612db8e-4d33-469a-9b98-e7920f09b036 ((None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}])) to volume cd3d4992-513c-491c-bccf-ee15b37e1a52. {{(pid=86064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 15:14:14 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-92d747fe-ca0b-4e20-8f82-cd651b9cc9fd tempest-GroupSnapshotsTest-23436513 None] GroupSnapshot 9cfe0851-0c0b-4038-b8a2-9eb44096d766: creating. Sep 23 15:14:14 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a78f48-3fa6-4a39-9314-cfec70244863]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:14:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_if55fdor {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-92d747fe-ca0b-4e20-8f82-cd651b9cc9fd tempest-GroupSnapshotsTest-23436513 None] Group snapshot 9cfe0851-0c0b-4038-b8a2-9eb44096d766: creating. {{(pid=86064) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 15:14:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-92d747fe-ca0b-4e20-8f82-cd651b9cc9fd tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:14:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-92d747fe-ca0b-4e20-8f82-cd651b9cc9fd tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:14:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-92d747fe-ca0b-4e20-8f82-cd651b9cc9fd tempest-GroupSnapshotsTest-23436513 None] Creating offline snapshot ba5e1709-8da0-474a-bf23-f989c2345b69 of volume 0dac9f07-ac67-424a-b686-909648487dc0 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:14:14 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe108769-64a3-4973-9181-7cc3c52df831]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:14:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-92d747fe-ca0b-4e20-8f82-cd651b9cc9fd tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:14 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_if55fdor Sep 23 15:14:14 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:14 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0 Sep 23 15:14:14 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aa4bcb8f-b4c2-4219-9d6f-e74ba8994807 tempest-ServerRescueNegativeTestJSON-709805673 None] Acquiring lock "cinder-ce65f047-101c-4324-9db2-dd0132144bcd-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:14:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aa4bcb8f-b4c2-4219-9d6f-e74ba8994807 tempest-ServerRescueNegativeTestJSON-709805673 None] Lock "cinder-ce65f047-101c-4324-9db2-dd0132144bcd-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:14:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aa4bcb8f-b4c2-4219-9d6f-e74ba8994807 tempest-ServerRescueNegativeTestJSON-709805673 None] Acquiring lock "cinder-quobyte-ce65f047-101c-4324-9db2-dd0132144bcd" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:14:15 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_if55fdor" returned: 0 in 0.674s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_if55fdor {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aa4bcb8f-b4c2-4219-9d6f-e74ba8994807 tempest-ServerRescueNegativeTestJSON-709805673 None] Lock "cinder-quobyte-ce65f047-101c-4324-9db2-dd0132144bcd" acquired by "delete_volume" :: waited 0.060s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:14:15 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ab5a15-c3e6-4164-b69e-5114f81d3d79]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:14:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aa4bcb8f-b4c2-4219-9d6f-e74ba8994807 tempest-ServerRescueNegativeTestJSON-709805673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce65f047-101c-4324-9db2-dd0132144bcd {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:15 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce65f047-101c-4324-9db2-dd0132144bcd Sep 23 15:14:15 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:15 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_if55fdor Sep 23 15:14:15 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:15 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-92d747fe-ca0b-4e20-8f82-cd651b9cc9fd tempest-GroupSnapshotsTest-23436513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0" returned: 0 in 1.041s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-92d747fe-ca0b-4e20-8f82-cd651b9cc9fd tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.ba5e1709-8da0-474a-bf23-f989c2345b69 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:15 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.ba5e1709-8da0-474a-bf23-f989c2345b69 1G Sep 23 15:14:15 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:16 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_if55fdor" returned: 1 in 0.815s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_if55fdor' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:14:16 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8beddf-6fd4-42b7-9ac2-dcd1fcdd2713]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:14:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036___9mtbgydevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:16 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036___9mtbgydevstack@QuobyteHD Sep 23 15:14:16 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:16 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aa4bcb8f-b4c2-4219-9d6f-e74ba8994807 tempest-ServerRescueNegativeTestJSON-709805673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce65f047-101c-4324-9db2-dd0132144bcd" returned: 0 in 1.030s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aa4bcb8f-b4c2-4219-9d6f-e74ba8994807 tempest-ServerRescueNegativeTestJSON-709805673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce65f047-101c-4324-9db2-dd0132144bcd {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:16 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce65f047-101c-4324-9db2-dd0132144bcd Sep 23 15:14:16 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:16 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:16 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036___9mtbgydevstack@QuobyteHD" returned: 0 in 0.854s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:16 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] e612db8e-4d33-469a-9b98-e7920f09b036 was qcow2, converting to qcow2 {{(pid=86064) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 15:14:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036___9mtbgydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd3d4992-513c-491c-bccf-ee15b37e1a52 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:16 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aa4bcb8f-b4c2-4219-9d6f-e74ba8994807 tempest-ServerRescueNegativeTestJSON-709805673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce65f047-101c-4324-9db2-dd0132144bcd" returned: 0 in 0.572s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-92d747fe-ca0b-4e20-8f82-cd651b9cc9fd tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.ba5e1709-8da0-474a-bf23-f989c2345b69 1G" returned: 0 in 1.212s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-92d747fe-ca0b-4e20-8f82-cd651b9cc9fd tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dac9f07-ac67-424a-b686-909648487dc0 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.ba5e1709-8da0-474a-bf23-f989c2345b69 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:16 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036___9mtbgydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd3d4992-513c-491c-bccf-ee15b37e1a52 Sep 23 15:14:16 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aa4bcb8f-b4c2-4219-9d6f-e74ba8994807 tempest-ServerRescueNegativeTestJSON-709805673 None] Lock "cinder-quobyte-ce65f047-101c-4324-9db2-dd0132144bcd" released by "delete_volume" :: held 1.736s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:14:16 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dac9f07-ac67-424a-b686-909648487dc0 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.ba5e1709-8da0-474a-bf23-f989c2345b69 Sep 23 15:14:16 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:17 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-aa4bcb8f-b4c2-4219-9d6f-e74ba8994807 tempest-ServerRescueNegativeTestJSON-709805673 None] Created reservations ['a9461d4a-1f3a-418e-91e6-c030b2687c2c', '3819d2f9-8663-4254-a7dc-8756e84f1aa9', 'ed29247a-d855-4341-b3b5-4e89aa6cfd2f', 'f29d488d-0525-4534-8cb1-4bc10f834354'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:14:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-aa4bcb8f-b4c2-4219-9d6f-e74ba8994807 tempest-ServerRescueNegativeTestJSON-709805673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:14:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-aa4bcb8f-b4c2-4219-9d6f-e74ba8994807 tempest-ServerRescueNegativeTestJSON-709805673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:14:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-aa4bcb8f-b4c2-4219-9d6f-e74ba8994807 tempest-ServerRescueNegativeTestJSON-709805673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:14:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-aa4bcb8f-b4c2-4219-9d6f-e74ba8994807 tempest-ServerRescueNegativeTestJSON-709805673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:14:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-aa4bcb8f-b4c2-4219-9d6f-e74ba8994807 tempest-ServerRescueNegativeTestJSON-709805673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:14:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aa4bcb8f-b4c2-4219-9d6f-e74ba8994807 tempest-ServerRescueNegativeTestJSON-709805673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:17 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:14:17 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:17 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-92d747fe-ca0b-4e20-8f82-cd651b9cc9fd tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dac9f07-ac67-424a-b686-909648487dc0 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.ba5e1709-8da0-474a-bf23-f989c2345b69" returned: 0 in 0.816s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:17 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-92d747fe-ca0b-4e20-8f82-cd651b9cc9fd tempest-GroupSnapshotsTest-23436513 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.ba5e1709-8da0-474a-bf23-f989c2345b69 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 15:14:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-92d747fe-ca0b-4e20-8f82-cd651b9cc9fd tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.ba5e1709-8da0-474a-bf23-f989c2345b69 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:17 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aa4bcb8f-b4c2-4219-9d6f-e74ba8994807 tempest-ServerRescueNegativeTestJSON-709805673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.590s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:17 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-aa4bcb8f-b4c2-4219-9d6f-e74ba8994807 tempest-ServerRescueNegativeTestJSON-709805673 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:14:17 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.ba5e1709-8da0-474a-bf23-f989c2345b69 Sep 23 15:14:17 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-aa4bcb8f-b4c2-4219-9d6f-e74ba8994807 tempest-ServerRescueNegativeTestJSON-709805673 None] Deleted volume successfully. Sep 23 15:14:17 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aa4bcb8f-b4c2-4219-9d6f-e74ba8994807 tempest-ServerRescueNegativeTestJSON-709805673 None] Lock "cinder-ce65f047-101c-4324-9db2-dd0132144bcd-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:14:18 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-92d747fe-ca0b-4e20-8f82-cd651b9cc9fd tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.ba5e1709-8da0-474a-bf23-f989c2345b69" returned: 0 in 1.220s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-92d747fe-ca0b-4e20-8f82-cd651b9cc9fd tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:19 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.info Sep 23 15:14:19 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:19 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-92d747fe-ca0b-4e20-8f82-cd651b9cc9fd tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.info" returned: 0 in 0.727s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:19 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-92d747fe-ca0b-4e20-8f82-cd651b9cc9fd tempest-GroupSnapshotsTest-23436513 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 15:14:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-92d747fe-ca0b-4e20-8f82-cd651b9cc9fd tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:19 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.info Sep 23 15:14:19 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:20 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-92d747fe-ca0b-4e20-8f82-cd651b9cc9fd tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.info" returned: 0 in 0.735s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-92d747fe-ca0b-4e20-8f82-cd651b9cc9fd tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.061s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:14:20 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:UPDATE=138,cinder:SELECT=118,cinder:INSERT=22,cinder:DELETE=8 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:14:20 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=117,cinder:UPDATE=129,cinder:DELETE=6,cinder:INSERT=42 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:14:20 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-92d747fe-ca0b-4e20-8f82-cd651b9cc9fd tempest-GroupSnapshotsTest-23436513 None] group_snapshot 9cfe0851-0c0b-4038-b8a2-9eb44096d766: created successfully Sep 23 15:14:21 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] group_snapshot 9cfe0851-0c0b-4038-b8a2-9eb44096d766: deleting Sep 23 15:14:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] group_snapshot 9cfe0851-0c0b-4038-b8a2-9eb44096d766: deleting {{(pid=86064) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 15:14:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "cinder-quobyte-0dac9f07-ac67-424a-b686-909648487dc0" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:14:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-0dac9f07-ac67-424a-b686-909648487dc0" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:14:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "cinder-quobyte-ba5e1709-8da0-474a-bf23-f989c2345b69" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:14:21 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036___9mtbgydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd3d4992-513c-491c-bccf-ee15b37e1a52" returned: 0 in 5.001s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:21 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036___9mtbgydevstack@QuobyteHD, size 112.00 MB, duration 5.00 sec, destination /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd3d4992-513c-491c-bccf-ee15b37e1a52 {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:14:21 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Converted 112.00 MB image at 22.38 MB/s Sep 23 15:14:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd3d4992-513c-491c-bccf-ee15b37e1a52 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-ba5e1709-8da0-474a-bf23-f989c2345b69" acquired by "_delete_snapshot" :: waited 0.081s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:14:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] Deleting offline snapshot ba5e1709-8da0-474a-bf23-f989c2345b69 of volume 0dac9f07-ac67-424a-b686-909648487dc0 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:14:21 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd3d4992-513c-491c-bccf-ee15b37e1a52 1G Sep 23 15:14:21 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] snapshot_file for this snap is: volume-0dac9f07-ac67-424a-b686-909648487dc0.ba5e1709-8da0-474a-bf23-f989c2345b69 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:14:22 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9101ac-5f47-4387-95a2-81b3cf70018e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:14:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.ba5e1709-8da0-474a-bf23-f989c2345b69 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:22 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.ba5e1709-8da0-474a-bf23-f989c2345b69 Sep 23 15:14:22 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:22 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd3d4992-513c-491c-bccf-ee15b37e1a52 1G" returned: 0 in 0.813s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:22 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Downloaded image e612db8e-4d33-469a-9b98-e7920f09b036 ((None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}])) to volume cd3d4992-513c-491c-bccf-ee15b37e1a52 successfully. {{(pid=86064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 15:14:22 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Temporary image e612db8e-4d33-469a-9b98-e7920f09b036 for user df3159505d304665930ae644bb17d08a is deleted. {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 15:14:22 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Marking volume cd3d4992-513c-491c-bccf-ee15b37e1a52 as bootable. {{(pid=86064) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 15:14:22 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Copying metadata from image e612db8e-4d33-469a-9b98-e7920f09b036 to cd3d4992-513c-491c-bccf-ee15b37e1a52. {{(pid=86064) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 15:14:22 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Creating volume glance metadata for volume cd3d4992-513c-491c-bccf-ee15b37e1a52 backed by image e612db8e-4d33-469a-9b98-e7920f09b036 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86064) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 15:14:22 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.ba5e1709-8da0-474a-bf23-f989c2345b69" returned: 0 in 0.677s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dac9f07-ac67-424a-b686-909648487dc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:14:22 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a47c5c-2056-4a88-a321-3433a2a22827]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:14:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc37037-b181-4541-825a-0c577efbd275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd3d4992-513c-491c-bccf-ee15b37e1a52', 'volume_size': 1, 'image_id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6096e44b8882450f8963b9e995032e95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'created_at': datetime.datetime(2026, 9, 23, 13, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e612db8e-4d33-469a-9b98-e7920f09b036/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99ebefd-b15b-432c-8907-11bca61c2aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:23 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Volume volume-cd3d4992-513c-491c-bccf-ee15b37e1a52 (cd3d4992-513c-491c-bccf-ee15b37e1a52): created successfully Sep 23 15:14:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99ebefd-b15b-432c-8907-11bca61c2aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Flow 'volume_create_manager' (8220c5a9-599b-4b35-bf08-78bc30ad5bce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:14:23 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0 Sep 23 15:14:23 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:23 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-b9de8092-54da-46b0-a9be-771e5e205f35 tempest-VolumesGetTest-1118423804 None] Created volume successfully. Sep 23 15:14:23 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0" returned: 0 in 0.704s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.ba5e1709-8da0-474a-bf23-f989c2345b69 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:23 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.ba5e1709-8da0-474a-bf23-f989c2345b69 Sep 23 15:14:23 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:24 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.ba5e1709-8da0-474a-bf23-f989c2345b69" returned: 0 in 0.599s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.ba5e1709-8da0-474a-bf23-f989c2345b69 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:24 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.ba5e1709-8da0-474a-bf23-f989c2345b69 Sep 23 15:14:24 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:24 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0.ba5e1709-8da0-474a-bf23-f989c2345b69" returned: 0 in 0.421s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-ba5e1709-8da0-474a-bf23-f989c2345b69" released by "_delete_snapshot" :: held 2.780s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:14:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-0dac9f07-ac67-424a-b686-909648487dc0" released by "delete_snapshot" :: held 2.882s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:14:24 devstack cinder-volume[86064]: WARNING cinder.quota [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-459515713 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-459515713, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:14:25 devstack cinder-volume[86064]: WARNING cinder.quota [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-459515713 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-459515713, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Flow 'volume_create_manager' (16ce4e89-49f7-4784-b5ec-8edbaabb90e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0e45f0-5456-4577-9938-0d77b0773a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0e45f0-5456-4577-9938-0d77b0773a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:14:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-461673721',display_name='tempest-VolumesGetTest-Volume-1082719940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74129afb-3230-4bbe-853f-976c2128f236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c0a8089a4e4d85a67357adc5e38c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:14:25Z,use_quota=True,user_id='df3159505d304665930ae644bb17d08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee82867-e179-4b7f-b127-92aa7a80981f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee82867-e179-4b7f-b127-92aa7a80981f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a95d8e-f684-44a5-9d14-80a19dbc30a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a95d8e-f684-44a5-9d14-80a19dbc30a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74129afb-3230-4bbe-853f-976c2128f236', 'volume_name': 'volume-74129afb-3230-4bbe-853f-976c2128f236', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3761a89-5545-4014-94a7-fc45dd838ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3761a89-5545-4014-94a7-fc45dd838ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9604114a-43f2-428b-bde9-0f7109cc64d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:25 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Volume 74129afb-3230-4bbe-853f-976c2128f236: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74129afb-3230-4bbe-853f-976c2128f236', 'volume_size': 1} Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:14:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-461673721',display_name='tempest-VolumesGetTest-Volume-1082719940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74129afb-3230-4bbe-853f-976c2128f236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c0a8089a4e4d85a67357adc5e38c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:14:25Z,use_quota=True,user_id='df3159505d304665930ae644bb17d08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Creating volume 74129afb-3230-4bbe-853f-976c2128f236 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:14:25 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-74129afb-3230-4bbe-853f-976c2128f236 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:25 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] Created reservations ['d72cb361-7439-463f-b4c2-bdfa127bc4bf', '966bdbc1-ae05-40d6-bc3a-c1ad56da543e', 'c5834a60-67db-404d-90a1-df2c9e0d8b4a', 'dc1d2988-2ac3-4a71-b723-e7df10f1dbf8'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:14:25 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-74129afb-3230-4bbe-853f-976c2128f236 1073741824 Sep 23 15:14:25 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:25 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-0dbd3688-3953-47c9-8749-0fea7a84381a tempest-GroupSnapshotsTest-23436513 None] group_snapshot 9cfe0851-0c0b-4038-b8a2-9eb44096d766: deleted successfully Sep 23 15:14:26 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5d667475-caa8-4b33-98b1-89c16751c114 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "cinder-quobyte-0dac9f07-ac67-424a-b686-909648487dc0" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:14:26 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-74129afb-3230-4bbe-853f-976c2128f236 1073741824" returned: 0 in 0.969s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:26 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5d667475-caa8-4b33-98b1-89c16751c114 tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-0dac9f07-ac67-424a-b686-909648487dc0" acquired by "delete_volume" :: waited 0.082s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:14:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-74129afb-3230-4bbe-853f-976c2128f236 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:26 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fc4f15-0bbb-4ccd-af19-431ebbdf6255]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:14:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5d667475-caa8-4b33-98b1-89c16751c114 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:26 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-74129afb-3230-4bbe-853f-976c2128f236 Sep 23 15:14:26 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:26 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0 Sep 23 15:14:26 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:26 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-74129afb-3230-4bbe-853f-976c2128f236" returned: 0 in 0.562s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:14:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:14:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9604114a-43f2-428b-bde9-0f7109cc64d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74129afb-3230-4bbe-853f-976c2128f236', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0831c6b3-5a50-49d8-ac60-2b9b7f43bacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:14:26 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Volume volume-74129afb-3230-4bbe-853f-976c2128f236 (74129afb-3230-4bbe-853f-976c2128f236): created successfully Sep 23 15:14:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0831c6b3-5a50-49d8-ac60-2b9b7f43bacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:14:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Flow 'volume_create_manager' (16ce4e89-49f7-4784-b5ec-8edbaabb90e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:14:27 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-4745a678-e15a-4c79-976d-2f6a097e0ba9 tempest-VolumesGetTest-1118423804 None] Created volume successfully. Sep 23 15:14:27 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5d667475-caa8-4b33-98b1-89c16751c114 tempest-GroupSnapshotsTest-23436513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0" returned: 0 in 0.816s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5d667475-caa8-4b33-98b1-89c16751c114 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:27 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0 Sep 23 15:14:27 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:27 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5d667475-caa8-4b33-98b1-89c16751c114 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0dac9f07-ac67-424a-b686-909648487dc0" returned: 0 in 0.325s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:27 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5d667475-caa8-4b33-98b1-89c16751c114 tempest-GroupSnapshotsTest-23436513 None] Lock "cinder-quobyte-0dac9f07-ac67-424a-b686-909648487dc0" released by "delete_volume" :: held 1.287s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:14:27 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-5d667475-caa8-4b33-98b1-89c16751c114 tempest-GroupSnapshotsTest-23436513 None] Created reservations ['e9e294e5-ffbf-4207-b9bf-58186399702c'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:14:27 devstack cinder-volume[86064]: WARNING cinder.quota [None req-5d667475-caa8-4b33-98b1-89c16751c114 tempest-GroupSnapshotsTest-23436513 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-459515713 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-459515713, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:14:27 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-5d667475-caa8-4b33-98b1-89c16751c114 tempest-GroupSnapshotsTest-23436513 None] Created reservations ['bc6b76bf-836f-4965-a4a0-6fb1fed87e03', 'addf7514-5011-49c7-af22-a4b0b9acff3a', '31f084d1-d5e9-490e-bbcf-f4742db68c67', '1245b221-9851-4e23-a2d7-47fea2f06e3c'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:14:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5d667475-caa8-4b33-98b1-89c16751c114 tempest-GroupSnapshotsTest-23436513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:14:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5d667475-caa8-4b33-98b1-89c16751c114 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:14:27 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5d667475-caa8-4b33-98b1-89c16751c114 tempest-GroupSnapshotsTest-23436513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:14:27 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5d667475-caa8-4b33-98b1-89c16751c114 tempest-GroupSnapshotsTest-23436513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:14:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5d667475-caa8-4b33-98b1-89c16751c114 tempest-GroupSnapshotsTest-23436513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:14:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5d667475-caa8-4b33-98b1-89c16751c114 tempest-GroupSnapshotsTest-23436513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:27 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:14:27 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:28 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5d667475-caa8-4b33-98b1-89c16751c114 tempest-GroupSnapshotsTest-23436513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.311s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:28 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-5d667475-caa8-4b33-98b1-89c16751c114 tempest-GroupSnapshotsTest-23436513 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:14:28 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5d667475-caa8-4b33-98b1-89c16751c114 tempest-GroupSnapshotsTest-23436513 None] Delete group completed successfully. Sep 23 15:14:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3f289695-829d-4063-9652-c257f60dd1bd tempest-VolumesGetTest-1118423804 None] Acquiring lock "cinder-74129afb-3230-4bbe-853f-976c2128f236-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:14:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3f289695-829d-4063-9652-c257f60dd1bd tempest-VolumesGetTest-1118423804 None] Lock "cinder-74129afb-3230-4bbe-853f-976c2128f236-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:14:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3f289695-829d-4063-9652-c257f60dd1bd tempest-VolumesGetTest-1118423804 None] Acquiring lock "cinder-quobyte-74129afb-3230-4bbe-853f-976c2128f236" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:14:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3f289695-829d-4063-9652-c257f60dd1bd tempest-VolumesGetTest-1118423804 None] Lock "cinder-quobyte-74129afb-3230-4bbe-853f-976c2128f236" acquired by "delete_volume" :: waited 0.029s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:14:28 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d9197d-f847-4e33-bbb3-1bb7b52eabd9]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:14:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3f289695-829d-4063-9652-c257f60dd1bd tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-74129afb-3230-4bbe-853f-976c2128f236 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:28 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-74129afb-3230-4bbe-853f-976c2128f236 Sep 23 15:14:28 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:29 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3f289695-829d-4063-9652-c257f60dd1bd tempest-VolumesGetTest-1118423804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-74129afb-3230-4bbe-853f-976c2128f236" returned: 0 in 0.588s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3f289695-829d-4063-9652-c257f60dd1bd tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-74129afb-3230-4bbe-853f-976c2128f236 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:29 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-74129afb-3230-4bbe-853f-976c2128f236 Sep 23 15:14:29 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:29 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3f289695-829d-4063-9652-c257f60dd1bd tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-74129afb-3230-4bbe-853f-976c2128f236" returned: 0 in 0.301s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3f289695-829d-4063-9652-c257f60dd1bd tempest-VolumesGetTest-1118423804 None] Lock "cinder-quobyte-74129afb-3230-4bbe-853f-976c2128f236" released by "delete_volume" :: held 0.952s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:14:29 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-3f289695-829d-4063-9652-c257f60dd1bd tempest-VolumesGetTest-1118423804 None] Created reservations ['dd75ceac-3ed5-4cde-8bdc-87f94b5e2091', '5423fd34-dffc-4507-8c64-b36fe9aef88d', 'b58f6317-e073-471a-a6a4-4ce20106e304', '6aad3043-97f4-4831-b3f2-0d150811e8a7'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:14:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3f289695-829d-4063-9652-c257f60dd1bd tempest-VolumesGetTest-1118423804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:14:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3f289695-829d-4063-9652-c257f60dd1bd tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:14:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3f289695-829d-4063-9652-c257f60dd1bd tempest-VolumesGetTest-1118423804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:14:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3f289695-829d-4063-9652-c257f60dd1bd tempest-VolumesGetTest-1118423804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:14:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3f289695-829d-4063-9652-c257f60dd1bd tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:14:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3f289695-829d-4063-9652-c257f60dd1bd tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:29 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:14:29 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:29 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3f289695-829d-4063-9652-c257f60dd1bd tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.377s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:29 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-3f289695-829d-4063-9652-c257f60dd1bd tempest-VolumesGetTest-1118423804 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:14:29 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-3f289695-829d-4063-9652-c257f60dd1bd tempest-VolumesGetTest-1118423804 None] Deleted volume successfully. Sep 23 15:14:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3f289695-829d-4063-9652-c257f60dd1bd tempest-VolumesGetTest-1118423804 None] Lock "cinder-74129afb-3230-4bbe-853f-976c2128f236-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:14:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6ad10e93-9cf8-4e7d-802b-a3bd2ed20fd3 tempest-VolumesGetTest-1118423804 None] Acquiring lock "cinder-cd3d4992-513c-491c-bccf-ee15b37e1a52-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:14:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6ad10e93-9cf8-4e7d-802b-a3bd2ed20fd3 tempest-VolumesGetTest-1118423804 None] Lock "cinder-cd3d4992-513c-491c-bccf-ee15b37e1a52-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:14:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6ad10e93-9cf8-4e7d-802b-a3bd2ed20fd3 tempest-VolumesGetTest-1118423804 None] Acquiring lock "cinder-quobyte-cd3d4992-513c-491c-bccf-ee15b37e1a52" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:14:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6ad10e93-9cf8-4e7d-802b-a3bd2ed20fd3 tempest-VolumesGetTest-1118423804 None] Lock "cinder-quobyte-cd3d4992-513c-491c-bccf-ee15b37e1a52" acquired by "delete_volume" :: waited 0.024s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:14:31 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4c615e-f9ca-425d-9916-a4531959fc8a]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:14:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6ad10e93-9cf8-4e7d-802b-a3bd2ed20fd3 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd3d4992-513c-491c-bccf-ee15b37e1a52 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:31 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd3d4992-513c-491c-bccf-ee15b37e1a52 Sep 23 15:14:31 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:31 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6ad10e93-9cf8-4e7d-802b-a3bd2ed20fd3 tempest-VolumesGetTest-1118423804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd3d4992-513c-491c-bccf-ee15b37e1a52" returned: 0 in 0.595s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6ad10e93-9cf8-4e7d-802b-a3bd2ed20fd3 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd3d4992-513c-491c-bccf-ee15b37e1a52 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:31 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd3d4992-513c-491c-bccf-ee15b37e1a52 Sep 23 15:14:31 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:31 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6ad10e93-9cf8-4e7d-802b-a3bd2ed20fd3 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd3d4992-513c-491c-bccf-ee15b37e1a52" returned: 0 in 0.294s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6ad10e93-9cf8-4e7d-802b-a3bd2ed20fd3 tempest-VolumesGetTest-1118423804 None] Lock "cinder-quobyte-cd3d4992-513c-491c-bccf-ee15b37e1a52" released by "delete_volume" :: held 0.955s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:14:32 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-6ad10e93-9cf8-4e7d-802b-a3bd2ed20fd3 tempest-VolumesGetTest-1118423804 None] Created reservations ['ce9c564b-5375-40a3-8482-98428c3f1bc7', 'b0d82e05-cc72-4d9e-98bc-6ace436638d3', 'cb6e3191-eabe-4f8f-845a-8f4510395f1b', '4a4b81e8-2597-4cac-a213-871c5278000d'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:14:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6ad10e93-9cf8-4e7d-802b-a3bd2ed20fd3 tempest-VolumesGetTest-1118423804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:14:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6ad10e93-9cf8-4e7d-802b-a3bd2ed20fd3 tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:14:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6ad10e93-9cf8-4e7d-802b-a3bd2ed20fd3 tempest-VolumesGetTest-1118423804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:14:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6ad10e93-9cf8-4e7d-802b-a3bd2ed20fd3 tempest-VolumesGetTest-1118423804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:14:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6ad10e93-9cf8-4e7d-802b-a3bd2ed20fd3 tempest-VolumesGetTest-1118423804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:14:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6ad10e93-9cf8-4e7d-802b-a3bd2ed20fd3 tempest-VolumesGetTest-1118423804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:32 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:14:32 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:32 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6ad10e93-9cf8-4e7d-802b-a3bd2ed20fd3 tempest-VolumesGetTest-1118423804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.442s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:32 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-6ad10e93-9cf8-4e7d-802b-a3bd2ed20fd3 tempest-VolumesGetTest-1118423804 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:14:32 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-6ad10e93-9cf8-4e7d-802b-a3bd2ed20fd3 tempest-VolumesGetTest-1118423804 None] Deleted volume successfully. Sep 23 15:14:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6ad10e93-9cf8-4e7d-802b-a3bd2ed20fd3 tempest-VolumesGetTest-1118423804 None] Lock "cinder-cd3d4992-513c-491c-bccf-ee15b37e1a52-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:14:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:14:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:14:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:14:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:14:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:14:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:14:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:14:36 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:14:36 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:14:36 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Sep 23 15:14:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.292s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:14:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:14:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:14:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 28 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:14:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:14:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ad2141c1-2cf7-4bd3-a523-8864cfa07983 tempest-BackendsCapabilitiesAdminTestsJSON-1522202317 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4478797912598, 'free_capacity_gb': 1775.4478797912598, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86064) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 15:14:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fcbafb31-4d98-4cd7-b825-d66ffb664b2e tempest-BackendsCapabilitiesAdminTestsJSON-1522202317 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4478797912598, 'free_capacity_gb': 1775.4478797912598, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86064) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 15:14:42 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=42,cinder:UPDATE=35,cinder:INSERT=12,cinder:DELETE=1 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:14:42 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=30,cinder:INSERT=18,cinder:UPDATE=43,cinder:DELETE=3 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Flow 'volume_create_manager' (41616198-d248-4856-8b59-a99e50c630b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da9a6b8-7ffd-4327-9cc0-ec3173be4ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da9a6b8-7ffd-4327-9cc0-ec3173be4ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1271089706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9334bc-e377-4951-9213-351becdb2cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbe070d0bf24290acefbf1394d47852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:04Z,use_quota=True,user_id='a428a930bb4a41a1808dfcbcdfeed252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47130da4-6f53-46ef-829a-db52e079115e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47130da4-6f53-46ef-829a-db52e079115e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3fcc5c3-002c-4a69-833a-a2c40e4dbed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3fcc5c3-002c-4a69-833a-a2c40e4dbed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d9334bc-e377-4951-9213-351becdb2cba', 'volume_name': 'volume-5d9334bc-e377-4951-9213-351becdb2cba', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2dc7d32-32a0-4b0e-a2d4-61046b7be117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2dc7d32-32a0-4b0e-a2d4-61046b7be117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (273dc8b6-83b0-4530-9feb-3845601bb6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:04 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Volume 5d9334bc-e377-4951-9213-351becdb2cba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d9334bc-e377-4951-9213-351becdb2cba', 'volume_size': 1} Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1271089706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9334bc-e377-4951-9213-351becdb2cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbe070d0bf24290acefbf1394d47852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:04Z,use_quota=True,user_id='a428a930bb4a41a1808dfcbcdfeed252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Creating volume 5d9334bc-e377-4951-9213-351becdb2cba {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:15:04 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d9334bc-e377-4951-9213-351becdb2cba 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:04 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d9334bc-e377-4951-9213-351becdb2cba 1073741824 Sep 23 15:15:04 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:04 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d9334bc-e377-4951-9213-351becdb2cba 1073741824" returned: 0 in 0.529s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d9334bc-e377-4951-9213-351becdb2cba {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:04 devstack sudo[96415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d9334bc-e377-4951-9213-351becdb2cba Sep 23 15:15:04 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:05 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d9334bc-e377-4951-9213-351becdb2cba" returned: 0 in 0.330s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:15:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (273dc8b6-83b0-4530-9feb-3845601bb6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d9334bc-e377-4951-9213-351becdb2cba', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7439b320-4f19-4390-a8be-c22d2a8790d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:05 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Volume volume-5d9334bc-e377-4951-9213-351becdb2cba (5d9334bc-e377-4951-9213-351becdb2cba): created successfully Sep 23 15:15:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7439b320-4f19-4390-a8be-c22d2a8790d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Flow 'volume_create_manager' (41616198-d248-4856-8b59-a99e50c630b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:05 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-0b4e8c5a-05b0-42c4-b856-8240f6744002 tempest-VolumesListAdminTestJSON-452256953 None] Created volume successfully. Sep 23 15:15:06 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:15:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Flow 'volume_create_manager' (2625df03-688e-430c-88ae-ada41d1dc0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd682a8-2979-4f84-88af-610372d7569b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd682a8-2979-4f84-88af-610372d7569b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-807746785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ee2572-4c81-4e5f-9d5b-cb7790820c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbe070d0bf24290acefbf1394d47852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:07Z,use_quota=True,user_id='a428a930bb4a41a1808dfcbcdfeed252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9afab57-7b93-415a-ab6d-add736e8fdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9afab57-7b93-415a-ab6d-add736e8fdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e48f55-cd6e-4cbd-8a7b-b3af436eb9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e48f55-cd6e-4cbd-8a7b-b3af436eb9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8ee2572-4c81-4e5f-9d5b-cb7790820c96', 'volume_name': 'volume-c8ee2572-4c81-4e5f-9d5b-cb7790820c96', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da93392-7653-41d7-b6bc-fd15d1c5ec1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da93392-7653-41d7-b6bc-fd15d1c5ec1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fef9cee-e54f-4293-b753-19bd2ab8b884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:07 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Volume c8ee2572-4c81-4e5f-9d5b-cb7790820c96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8ee2572-4c81-4e5f-9d5b-cb7790820c96', 'volume_size': 1} Sep 23 15:15:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-807746785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ee2572-4c81-4e5f-9d5b-cb7790820c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbe070d0bf24290acefbf1394d47852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:07Z,use_quota=True,user_id='a428a930bb4a41a1808dfcbcdfeed252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:15:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Creating volume c8ee2572-4c81-4e5f-9d5b-cb7790820c96 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:15:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:15:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:15:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:15:07 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:15:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c8ee2572-4c81-4e5f-9d5b-cb7790820c96 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:07 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c8ee2572-4c81-4e5f-9d5b-cb7790820c96 1073741824 Sep 23 15:15:07 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:07 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c8ee2572-4c81-4e5f-9d5b-cb7790820c96 1073741824" returned: 0 in 0.588s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c8ee2572-4c81-4e5f-9d5b-cb7790820c96 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:07 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c8ee2572-4c81-4e5f-9d5b-cb7790820c96 Sep 23 15:15:07 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:08 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c8ee2572-4c81-4e5f-9d5b-cb7790820c96" returned: 0 in 0.321s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:15:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fef9cee-e54f-4293-b753-19bd2ab8b884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8ee2572-4c81-4e5f-9d5b-cb7790820c96', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b2b11d1-9851-4435-8d98-bdbb5ed060fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:08 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Volume volume-c8ee2572-4c81-4e5f-9d5b-cb7790820c96 (c8ee2572-4c81-4e5f-9d5b-cb7790820c96): created successfully Sep 23 15:15:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b2b11d1-9851-4435-8d98-bdbb5ed060fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Flow 'volume_create_manager' (2625df03-688e-430c-88ae-ada41d1dc0f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:08 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7ccf19b0-48ae-46d1-906e-38aca4c7772d tempest-VolumesListAdminTestJSON-452256953 None] Created volume successfully. Sep 23 15:15:09 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:15:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Flow 'volume_create_manager' (31ab3214-bf9d-45f3-acad-63b8b4837b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8b7db9-a011-44f9-991e-c87e7ee4ddd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8b7db9-a011-44f9-991e-c87e7ee4ddd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1896140301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbe070d0bf24290acefbf1394d47852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:10Z,use_quota=True,user_id='a428a930bb4a41a1808dfcbcdfeed252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ed612d-0fd0-49a3-8242-06e973f2717c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ed612d-0fd0-49a3-8242-06e973f2717c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6cbf0e4-54db-4754-98a0-bc7b181bbb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6cbf0e4-54db-4754-98a0-bc7b181bbb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c', 'volume_name': 'volume-9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b87bee1-b242-442b-bb24-f8c2ce5609b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b87bee1-b242-442b-bb24-f8c2ce5609b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c014dea9-56c3-4119-b51b-98f1e1f4e162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:10 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Volume 9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c', 'volume_size': 1} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1896140301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbe070d0bf24290acefbf1394d47852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:10Z,use_quota=True,user_id='a428a930bb4a41a1808dfcbcdfeed252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Creating volume 9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:15:10 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:10 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c 1073741824 Sep 23 15:15:10 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Flow 'volume_create_manager' (4caeea26-ef12-4605-83e1-9ee251e726cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3fc5fe2-8061-4baa-bc24-8e537386ba9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:10 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3fc5fe2-8061-4baa-bc24-8e537386ba9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1706622023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32efe93b-b907-4c8d-bd9d-4e14599109c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60f0c632c5048d59c55fb03e1d900c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:11Z,use_quota=True,user_id='a3cc76601d5345228704d10a97ee3c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95ca1f9c-3aa5-43be-ad9d-8a92ff6210ef),volume_type_id=95ca1f9c-3aa5-43be-ad9d-8a92ff6210ef)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab914e0-c242-4575-9fff-4351f79ea434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab914e0-c242-4575-9fff-4351f79ea434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d336d5-f5eb-4cf8-9188-a6e324ce42b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d336d5-f5eb-4cf8-9188-a6e324ce42b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32efe93b-b907-4c8d-bd9d-4e14599109c7', 'volume_name': 'volume-32efe93b-b907-4c8d-bd9d-4e14599109c7', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d00cc3b-bef7-4e2a-b396-caaa4a5f0810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d00cc3b-bef7-4e2a-b396-caaa4a5f0810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9419326-c4b5-4b7a-84fb-f34eedc5a4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:10 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Volume 32efe93b-b907-4c8d-bd9d-4e14599109c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32efe93b-b907-4c8d-bd9d-4e14599109c7', 'volume_size': 1} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c 1073741824" returned: 0 in 0.726s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:10 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c Sep 23 15:15:10 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:11 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c" returned: 0 in 0.335s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:15:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.385s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1706622023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32efe93b-b907-4c8d-bd9d-4e14599109c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60f0c632c5048d59c55fb03e1d900c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:11Z,use_quota=True,user_id='a3cc76601d5345228704d10a97ee3c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95ca1f9c-3aa5-43be-ad9d-8a92ff6210ef),volume_type_id=95ca1f9c-3aa5-43be-ad9d-8a92ff6210ef)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:15:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Creating volume 32efe93b-b907-4c8d-bd9d-4e14599109c7 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:15:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:15:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:15:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:15:11 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:15:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-32efe93b-b907-4c8d-bd9d-4e14599109c7 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c014dea9-56c3-4119-b51b-98f1e1f4e162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e809cd40-bf64-4e59-aac7-e01746acbfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:11 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-32efe93b-b907-4c8d-bd9d-4e14599109c7 1073741824 Sep 23 15:15:11 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:11 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Volume volume-9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c (9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c): created successfully Sep 23 15:15:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e809cd40-bf64-4e59-aac7-e01746acbfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Flow 'volume_create_manager' (31ab3214-bf9d-45f3-acad-63b8b4837b35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:11 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-8d08d011-a20c-413a-acfe-4ec7eba6aa52 tempest-VolumesListAdminTestJSON-452256953 None] Created volume successfully. Sep 23 15:15:11 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-32efe93b-b907-4c8d-bd9d-4e14599109c7 1073741824" returned: 0 in 0.641s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-32efe93b-b907-4c8d-bd9d-4e14599109c7 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:11 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-32efe93b-b907-4c8d-bd9d-4e14599109c7 Sep 23 15:15:11 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:12 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-32efe93b-b907-4c8d-bd9d-4e14599109c7" returned: 0 in 0.518s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9419326-c4b5-4b7a-84fb-f34eedc5a4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32efe93b-b907-4c8d-bd9d-4e14599109c7', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049a910d-d7a8-49ab-a165-6d7653d7ee35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:12 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Volume volume-32efe93b-b907-4c8d-bd9d-4e14599109c7 (32efe93b-b907-4c8d-bd9d-4e14599109c7): created successfully Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049a910d-d7a8-49ab-a165-6d7653d7ee35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Flow 'volume_create_manager' (4caeea26-ef12-4605-83e1-9ee251e726cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:12 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-6f31e9c2-c288-49f8-9090-6b98594c2249 tempest-VolumeTypesAccessTest-22661338 None] Created volume successfully. Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Flow 'volume_create_manager' (527094dd-041e-4ba5-9d6a-498cfb024a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4042f3e1-4e0b-4b73-b377-a6bac3190f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4042f3e1-4e0b-4b73-b377-a6bac3190f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-253575494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97044aa9-cbee-423d-948c-0fe106c68972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a5cf9d21424c7f8a6ee86f2c1a73f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:12Z,use_quota=True,user_id='ff2bef0d2dd74e1d8d4a8fe4f95a0d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(acb77554-354d-4518-8ff8-6127f5e837fc),volume_type_id=acb77554-354d-4518-8ff8-6127f5e837fc)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296a4f7a-431e-466b-8e3c-5f113fafe56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296a4f7a-431e-466b-8e3c-5f113fafe56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202a9b88-afb1-4562-8b48-81d2cdd34ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202a9b88-afb1-4562-8b48-81d2cdd34ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97044aa9-cbee-423d-948c-0fe106c68972', 'volume_name': 'volume-97044aa9-cbee-423d-948c-0fe106c68972', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e9b6c2-0480-4462-8026-b73fb6cee4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e9b6c2-0480-4462-8026-b73fb6cee4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80944ff3-c9ac-47bc-afaf-cdaa73867c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:12 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Volume 97044aa9-cbee-423d-948c-0fe106c68972: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97044aa9-cbee-423d-948c-0fe106c68972', 'volume_size': 1} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-253575494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97044aa9-cbee-423d-948c-0fe106c68972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a5cf9d21424c7f8a6ee86f2c1a73f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:12Z,use_quota=True,user_id='ff2bef0d2dd74e1d8d4a8fe4f95a0d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(acb77554-354d-4518-8ff8-6127f5e837fc),volume_type_id=acb77554-354d-4518-8ff8-6127f5e837fc)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Creating volume 97044aa9-cbee-423d-948c-0fe106c68972 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:15:12 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:15:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-97044aa9-cbee-423d-948c-0fe106c68972 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:12 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-97044aa9-cbee-423d-948c-0fe106c68972 1073741824 Sep 23 15:15:12 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Flow 'volume_create_manager' (b0e91484-7ffb-4ef0-9900-08902117f0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545cfb6e-5f85-4c89-a076-91d2303f9049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545cfb6e-5f85-4c89-a076-91d2303f9049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-79801715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb5fdab-67ef-477d-bca0-733c74bc767b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a5cf9d21424c7f8a6ee86f2c1a73f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:13Z,use_quota=True,user_id='ff2bef0d2dd74e1d8d4a8fe4f95a0d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f880d5-2553-40f8-8977-80510e653463),volume_type_id=03f880d5-2553-40f8-8977-80510e653463)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ab506c-f0cc-4b97-afa3-025325304159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ab506c-f0cc-4b97-afa3-025325304159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f2394f-4bfc-464c-9a17-8a13371a0b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f2394f-4bfc-464c-9a17-8a13371a0b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cb5fdab-67ef-477d-bca0-733c74bc767b', 'volume_name': 'volume-7cb5fdab-67ef-477d-bca0-733c74bc767b', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fac1f1c-5624-4664-a093-5d3fd8572f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fac1f1c-5624-4664-a093-5d3fd8572f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e950240e-db45-44c0-ad98-2dd0a27eed73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:13 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Volume 7cb5fdab-67ef-477d-bca0-733c74bc767b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cb5fdab-67ef-477d-bca0-733c74bc767b', 'volume_size': 1} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ad7d739f-e911-4637-9008-0b3ec977ddc6 tempest-VolumeTypesAccessTest-22661338 None] Acquiring lock "cinder-32efe93b-b907-4c8d-bd9d-4e14599109c7-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ad7d739f-e911-4637-9008-0b3ec977ddc6 tempest-VolumeTypesAccessTest-22661338 None] Lock "cinder-32efe93b-b907-4c8d-bd9d-4e14599109c7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Flow 'volume_create_manager' (274e23ad-0110-4045-b9a6-39820fff4ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6abe8b8b-d6bd-45fa-b8b5-324fb794ac17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:13 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-97044aa9-cbee-423d-948c-0fe106c68972 1073741824" returned: 0 in 0.975s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6abe8b8b-d6bd-45fa-b8b5-324fb794ac17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6936348-98a9-4124-bab3-ffb8e05262fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91aa8112e6a64aba80e87c0d0aa6938e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:13Z,use_quota=True,user_id='ff7dade947504d0481c834738971142f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab7cb9e-4f85-4ab7-820d-751dcb113913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab7cb9e-4f85-4ab7-820d-751dcb113913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ccff02-a4ca-4c6d-a5b1-e2bcccc2ffc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ccff02-a4ca-4c6d-a5b1-e2bcccc2ffc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6936348-98a9-4124-bab3-ffb8e05262fb', 'volume_name': 'volume-f6936348-98a9-4124-bab3-ffb8e05262fb', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (187df4a7-a498-431a-82a1-8d71cbd7a54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (187df4a7-a498-431a-82a1-8d71cbd7a54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94fc94b6-c8d4-4319-b22f-8bdb2e45d425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:13 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Volume f6936348-98a9-4124-bab3-ffb8e05262fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6936348-98a9-4124-bab3-ffb8e05262fb', 'volume_size': 1} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-97044aa9-cbee-423d-948c-0fe106c68972 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ad7d739f-e911-4637-9008-0b3ec977ddc6 tempest-VolumeTypesAccessTest-22661338 None] Acquiring lock "cinder-quobyte-32efe93b-b907-4c8d-bd9d-4e14599109c7" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:15:13 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-97044aa9-cbee-423d-948c-0fe106c68972 Sep 23 15:15:13 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ad7d739f-e911-4637-9008-0b3ec977ddc6 tempest-VolumeTypesAccessTest-22661338 None] Lock "cinder-quobyte-32efe93b-b907-4c8d-bd9d-4e14599109c7" acquired by "delete_volume" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[57995e80-1f2b-4482-b2b5-54b7cc49930c]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ad7d739f-e911-4637-9008-0b3ec977ddc6 tempest-VolumeTypesAccessTest-22661338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-32efe93b-b907-4c8d-bd9d-4e14599109c7 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:13 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-32efe93b-b907-4c8d-bd9d-4e14599109c7 Sep 23 15:15:13 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:13 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:15:13 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Flow 'volume_create_manager' (e13a6d56-7a32-4a10-80ba-ca7005b29860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed228fd7-9f25-4761-a8c5-b7e5c5ee72ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-97044aa9-cbee-423d-948c-0fe106c68972" returned: 0 in 0.320s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.811s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-79801715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb5fdab-67ef-477d-bca0-733c74bc767b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a5cf9d21424c7f8a6ee86f2c1a73f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:13Z,use_quota=True,user_id='ff2bef0d2dd74e1d8d4a8fe4f95a0d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03f880d5-2553-40f8-8977-80510e653463),volume_type_id=03f880d5-2553-40f8-8977-80510e653463)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Creating volume 7cb5fdab-67ef-477d-bca0-733c74bc767b {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:15:14 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7cb5fdab-67ef-477d-bca0-733c74bc767b 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed228fd7-9f25-4761-a8c5-b7e5c5ee72ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1084448348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26787467-14fb-4099-88ff-5d72fc3ec25e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a5cf9d21424c7f8a6ee86f2c1a73f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:14Z,use_quota=True,user_id='ff2bef0d2dd74e1d8d4a8fe4f95a0d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e8c14e6-ba07-4d86-b596-a084608a9f88),volume_type_id=1e8c14e6-ba07-4d86-b596-a084608a9f88)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:14 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7cb5fdab-67ef-477d-bca0-733c74bc767b 1073741824 Sep 23 15:15:14 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cab2521-1783-4540-aa20-a03707d98930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cab2521-1783-4540-aa20-a03707d98930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e558bea-7f55-4104-a478-3ed28b1080fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.image.glance [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Creating Keystone auth plugin from conf {{(pid=86064) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80944ff3-c9ac-47bc-afaf-cdaa73867c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97044aa9-cbee-423d-948c-0fe106c68972', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20e2f5ff-945d-42d6-b05b-8212560c34f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:14 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Volume volume-97044aa9-cbee-423d-948c-0fe106c68972 (97044aa9-cbee-423d-948c-0fe106c68972): created successfully Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20e2f5ff-945d-42d6-b05b-8212560c34f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Flow 'volume_create_manager' (527094dd-041e-4ba5-9d6a-498cfb024a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:14 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-3a8bfb3a-9963-45d9-b5bd-aaadef5f4d24 tempest-TestInstancesWithCinderVolumes-255478537 None] Created volume successfully. Sep 23 15:15:14 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ad7d739f-e911-4637-9008-0b3ec977ddc6 tempest-VolumeTypesAccessTest-22661338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-32efe93b-b907-4c8d-bd9d-4e14599109c7" returned: 0 in 0.523s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ad7d739f-e911-4637-9008-0b3ec977ddc6 tempest-VolumeTypesAccessTest-22661338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-32efe93b-b907-4c8d-bd9d-4e14599109c7 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:14 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-32efe93b-b907-4c8d-bd9d-4e14599109c7 Sep 23 15:15:14 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e558bea-7f55-4104-a478-3ed28b1080fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '26787467-14fb-4099-88ff-5d72fc3ec25e', 'volume_name': 'volume-26787467-14fb-4099-88ff-5d72fc3ec25e', 'volume_size': 1, 'image_id': '7d6f178f-605a-475d-a53c-0c1d18df3af1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d6f178f-605a-475d-a53c-0c1d18df3af1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--790021402', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '07a5cf9d21424c7f8a6ee86f2c1a73f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7d6f178f-605a-475d-a53c-0c1d18df3af1', 'created_at': datetime.datetime(2026, 9, 23, 13, 15, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 15, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d6f178f-605a-475d-a53c-0c1d18df3af1/file', 'properties': {}}, 'image_service': }' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269076a2-6208-4f40-93a0-7368d2c984f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269076a2-6208-4f40-93a0-7368d2c984f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b156161-b28b-4bc0-bf7b-5f2d73fb9384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:14 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Volume 26787467-14fb-4099-88ff-5d72fc3ec25e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-26787467-14fb-4099-88ff-5d72fc3ec25e', 'volume_size': 1, 'image_id': '7d6f178f-605a-475d-a53c-0c1d18df3af1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d6f178f-605a-475d-a53c-0c1d18df3af1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--790021402', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '07a5cf9d21424c7f8a6ee86f2c1a73f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7d6f178f-605a-475d-a53c-0c1d18df3af1', 'created_at': datetime.datetime(2026, 9, 23, 13, 15, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 15, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d6f178f-605a-475d-a53c-0c1d18df3af1/file', 'properties': {}}, 'image_service': } Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Trying to clone 26787467-14fb-4099-88ff-5d72fc3ec25e from image 7d6f178f-605a-475d-a53c-0c1d18df3af1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7d6f178f-605a-475d-a53c-0c1d18df3af1', 'metadata': {}}]). {{(pid=86064) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 15:15:14 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ad7d739f-e911-4637-9008-0b3ec977ddc6 tempest-VolumeTypesAccessTest-22661338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-32efe93b-b907-4c8d-bd9d-4e14599109c7" returned: 0 in 0.372s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ad7d739f-e911-4637-9008-0b3ec977ddc6 tempest-VolumeTypesAccessTest-22661338 None] Lock "cinder-quobyte-32efe93b-b907-4c8d-bd9d-4e14599109c7" released by "delete_volume" :: held 0.974s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:15:14 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7cb5fdab-67ef-477d-bca0-733c74bc767b 1073741824" returned: 0 in 0.685s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:14 devstack cinder-volume[86064]: WARNING cinder.quota [None req-ad7d739f-e911-4637-9008-0b3ec977ddc6 tempest-VolumeTypesAccessTest-22661338 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-590851596 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-590851596, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:15:14 devstack cinder-volume[86064]: WARNING cinder.quota [None req-ad7d739f-e911-4637-9008-0b3ec977ddc6 tempest-VolumeTypesAccessTest-22661338 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-590851596 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-590851596, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7cb5fdab-67ef-477d-bca0-733c74bc767b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:14 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7cb5fdab-67ef-477d-bca0-733c74bc767b Sep 23 15:15:14 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-ad7d739f-e911-4637-9008-0b3ec977ddc6 tempest-VolumeTypesAccessTest-22661338 None] Created reservations ['8c931090-d807-4086-a571-f983f16903eb', '6e1ccc79-ad62-4657-a38c-2009e90bdb8b', 'be6fc1cf-2c88-414a-bdba-75939858e3f1', '8cbf10d6-acd9-4075-a54c-e97cfb893190'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ad7d739f-e911-4637-9008-0b3ec977ddc6 tempest-VolumeTypesAccessTest-22661338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ad7d739f-e911-4637-9008-0b3ec977ddc6 tempest-VolumeTypesAccessTest-22661338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ad7d739f-e911-4637-9008-0b3ec977ddc6 tempest-VolumeTypesAccessTest-22661338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ad7d739f-e911-4637-9008-0b3ec977ddc6 tempest-VolumeTypesAccessTest-22661338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ad7d739f-e911-4637-9008-0b3ec977ddc6 tempest-VolumeTypesAccessTest-22661338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ad7d739f-e911-4637-9008-0b3ec977ddc6 tempest-VolumeTypesAccessTest-22661338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:15 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:15:15 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:15 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7cb5fdab-67ef-477d-bca0-733c74bc767b" returned: 0 in 0.606s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:15:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.737s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:15 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6936348-98a9-4124-bab3-ffb8e05262fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91aa8112e6a64aba80e87c0d0aa6938e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:13Z,use_quota=True,user_id='ff7dade947504d0481c834738971142f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:15:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Creating volume f6936348-98a9-4124-bab3-ffb8e05262fb {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:15:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:15:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:15:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:15:15 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:15:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f6936348-98a9-4124-bab3-ffb8e05262fb 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ad7d739f-e911-4637-9008-0b3ec977ddc6 tempest-VolumeTypesAccessTest-22661338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.500s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:15 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-ad7d739f-e911-4637-9008-0b3ec977ddc6 tempest-VolumeTypesAccessTest-22661338 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:15:15 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f6936348-98a9-4124-bab3-ffb8e05262fb 1073741824 Sep 23 15:15:15 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e950240e-db45-44c0-ad98-2dd0a27eed73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cb5fdab-67ef-477d-bca0-733c74bc767b', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98422b28-f285-4350-af0f-62fa11a17491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:15 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-ad7d739f-e911-4637-9008-0b3ec977ddc6 tempest-VolumeTypesAccessTest-22661338 None] Deleted volume successfully. Sep 23 15:15:15 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Volume volume-7cb5fdab-67ef-477d-bca0-733c74bc767b (7cb5fdab-67ef-477d-bca0-733c74bc767b): created successfully Sep 23 15:15:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98422b28-f285-4350-af0f-62fa11a17491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Flow 'volume_create_manager' (b0e91484-7ffb-4ef0-9900-08902117f0ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ad7d739f-e911-4637-9008-0b3ec977ddc6 tempest-VolumeTypesAccessTest-22661338 None] Lock "cinder-32efe93b-b907-4c8d-bd9d-4e14599109c7-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:15:15 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-b240571d-ec55-4c44-b2cf-a28dd4ba8080 tempest-TestInstancesWithCinderVolumes-255478537 None] Created volume successfully. Sep 23 15:15:16 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f6936348-98a9-4124-bab3-ffb8e05262fb 1073741824" returned: 0 in 0.910s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f6936348-98a9-4124-bab3-ffb8e05262fb {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:16 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f6936348-98a9-4124-bab3-ffb8e05262fb Sep 23 15:15:16 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:17 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f6936348-98a9-4124-bab3-ffb8e05262fb" returned: 0 in 0.642s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:15:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94fc94b6-c8d4-4319-b22f-8bdb2e45d425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6936348-98a9-4124-bab3-ffb8e05262fb', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad8befc-af51-492e-8d2c-a277e522aea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:17 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Volume volume-f6936348-98a9-4124-bab3-ffb8e05262fb (f6936348-98a9-4124-bab3-ffb8e05262fb): created successfully Sep 23 15:15:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad8befc-af51-492e-8d2c-a277e522aea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Flow 'volume_create_manager' (274e23ad-0110-4045-b9a6-39820fff4ab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:17 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7cd3320d-06e2-419a-8804-f4135661ca2b tempest-VolumesListAdminTestJSON-259051390 None] Created volume successfully. Sep 23 15:15:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4e2fdc1c-7bea-4221-8b9d-d07dfe2cd512 tempest-VolumesListAdminTestJSON-259051390 None] Acquiring lock "cinder-f6936348-98a9-4124-bab3-ffb8e05262fb-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:15:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4e2fdc1c-7bea-4221-8b9d-d07dfe2cd512 tempest-VolumesListAdminTestJSON-259051390 None] Lock "cinder-f6936348-98a9-4124-bab3-ffb8e05262fb-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:15:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4e2fdc1c-7bea-4221-8b9d-d07dfe2cd512 tempest-VolumesListAdminTestJSON-259051390 None] Acquiring lock "cinder-quobyte-f6936348-98a9-4124-bab3-ffb8e05262fb" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:15:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4e2fdc1c-7bea-4221-8b9d-d07dfe2cd512 tempest-VolumesListAdminTestJSON-259051390 None] Lock "cinder-quobyte-f6936348-98a9-4124-bab3-ffb8e05262fb" acquired by "delete_volume" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:15:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7f37129d-345e-432b-971f-c0f305e1a22d tempest-VolumesListAdminTestJSON-452256953 None] Acquiring lock "cinder-9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:15:18 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4209ef-4c20-4c41-bb45-613d2503aa37]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:15:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4e2fdc1c-7bea-4221-8b9d-d07dfe2cd512 tempest-VolumesListAdminTestJSON-259051390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f6936348-98a9-4124-bab3-ffb8e05262fb {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7f37129d-345e-432b-971f-c0f305e1a22d tempest-VolumesListAdminTestJSON-452256953 None] Lock "cinder-9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:15:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7f37129d-345e-432b-971f-c0f305e1a22d tempest-VolumesListAdminTestJSON-452256953 None] Acquiring lock "cinder-quobyte-9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:15:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7f37129d-345e-432b-971f-c0f305e1a22d tempest-VolumesListAdminTestJSON-452256953 None] Lock "cinder-quobyte-9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c" acquired by "delete_volume" :: waited 0.027s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:15:18 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8899296-cb92-4c18-accb-284e3fb6c86d]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:15:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7f37129d-345e-432b-971f-c0f305e1a22d tempest-VolumesListAdminTestJSON-452256953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:18 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f6936348-98a9-4124-bab3-ffb8e05262fb Sep 23 15:15:18 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:19 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c Sep 23 15:15:19 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:19 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7f37129d-345e-432b-971f-c0f305e1a22d tempest-VolumesListAdminTestJSON-452256953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c" returned: 0 in 0.651s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7f37129d-345e-432b-971f-c0f305e1a22d tempest-VolumesListAdminTestJSON-452256953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:19 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c Sep 23 15:15:19 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:19 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4e2fdc1c-7bea-4221-8b9d-d07dfe2cd512 tempest-VolumesListAdminTestJSON-259051390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f6936348-98a9-4124-bab3-ffb8e05262fb" returned: 0 in 1.011s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4e2fdc1c-7bea-4221-8b9d-d07dfe2cd512 tempest-VolumesListAdminTestJSON-259051390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f6936348-98a9-4124-bab3-ffb8e05262fb {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:19 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f6936348-98a9-4124-bab3-ffb8e05262fb Sep 23 15:15:19 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:20 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4e2fdc1c-7bea-4221-8b9d-d07dfe2cd512 tempest-VolumesListAdminTestJSON-259051390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-f6936348-98a9-4124-bab3-ffb8e05262fb" returned: 0 in 0.537s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:20 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7f37129d-345e-432b-971f-c0f305e1a22d tempest-VolumesListAdminTestJSON-452256953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c" returned: 0 in 0.702s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4e2fdc1c-7bea-4221-8b9d-d07dfe2cd512 tempest-VolumesListAdminTestJSON-259051390 None] Lock "cinder-quobyte-f6936348-98a9-4124-bab3-ffb8e05262fb" released by "delete_volume" :: held 1.661s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:15:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7f37129d-345e-432b-971f-c0f305e1a22d tempest-VolumesListAdminTestJSON-452256953 None] Lock "cinder-quobyte-9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c" released by "delete_volume" :: held 1.455s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:15:20 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-4e2fdc1c-7bea-4221-8b9d-d07dfe2cd512 tempest-VolumesListAdminTestJSON-259051390 None] Created reservations ['60839ea5-5758-4550-bc30-8e7fe9673023', '5d0b1eeb-1991-42bb-ac5a-60d9a1fae8f1', '1503078e-dde3-409c-b13f-961b86751d7f', 'ba81ff7d-767f-4c6e-8e0e-26ceba191815'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:15:20 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-7f37129d-345e-432b-971f-c0f305e1a22d tempest-VolumesListAdminTestJSON-452256953 None] Created reservations ['bd423360-0cec-4bf6-bb64-17527918b7e2', 'bd41c113-40ab-4e8f-ad19-1c7924a603b8', '16775d83-02b0-4080-a1e5-8e0a50308638', '713376c1-e751-4089-81b0-67d8ad7cbdba'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:15:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4e2fdc1c-7bea-4221-8b9d-d07dfe2cd512 tempest-VolumesListAdminTestJSON-259051390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4e2fdc1c-7bea-4221-8b9d-d07dfe2cd512 tempest-VolumesListAdminTestJSON-259051390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4e2fdc1c-7bea-4221-8b9d-d07dfe2cd512 tempest-VolumesListAdminTestJSON-259051390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:15:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4e2fdc1c-7bea-4221-8b9d-d07dfe2cd512 tempest-VolumesListAdminTestJSON-259051390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:15:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4e2fdc1c-7bea-4221-8b9d-d07dfe2cd512 tempest-VolumesListAdminTestJSON-259051390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4e2fdc1c-7bea-4221-8b9d-d07dfe2cd512 tempest-VolumesListAdminTestJSON-259051390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:20 devstack sudo[96632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:15:20 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7f37129d-345e-432b-971f-c0f305e1a22d tempest-VolumesListAdminTestJSON-452256953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7f37129d-345e-432b-971f-c0f305e1a22d tempest-VolumesListAdminTestJSON-452256953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7f37129d-345e-432b-971f-c0f305e1a22d tempest-VolumesListAdminTestJSON-452256953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:15:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7f37129d-345e-432b-971f-c0f305e1a22d tempest-VolumesListAdminTestJSON-452256953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:15:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7f37129d-345e-432b-971f-c0f305e1a22d tempest-VolumesListAdminTestJSON-452256953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7f37129d-345e-432b-971f-c0f305e1a22d tempest-VolumesListAdminTestJSON-452256953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:20 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:15:20 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:21 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7f37129d-345e-432b-971f-c0f305e1a22d tempest-VolumesListAdminTestJSON-452256953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.399s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:21 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-7f37129d-345e-432b-971f-c0f305e1a22d tempest-VolumesListAdminTestJSON-452256953 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:15:21 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7f37129d-345e-432b-971f-c0f305e1a22d tempest-VolumesListAdminTestJSON-452256953 None] Deleted volume successfully. Sep 23 15:15:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cd2c3ee7-61f8-404b-8e6d-44c1c328addb tempest-VolumesListAdminTestJSON-452256953 None] Acquiring lock "cinder-c8ee2572-4c81-4e5f-9d5b-cb7790820c96-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:15:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7f37129d-345e-432b-971f-c0f305e1a22d tempest-VolumesListAdminTestJSON-452256953 None] Lock "cinder-9711ce4a-afdc-48e6-bac6-8c2cf1e7e26c-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:15:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cd2c3ee7-61f8-404b-8e6d-44c1c328addb tempest-VolumesListAdminTestJSON-452256953 None] Lock "cinder-c8ee2572-4c81-4e5f-9d5b-cb7790820c96-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:15:21 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4e2fdc1c-7bea-4221-8b9d-d07dfe2cd512 tempest-VolumesListAdminTestJSON-259051390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.762s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:21 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-4e2fdc1c-7bea-4221-8b9d-d07dfe2cd512 tempest-VolumesListAdminTestJSON-259051390 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:15:21 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-4e2fdc1c-7bea-4221-8b9d-d07dfe2cd512 tempest-VolumesListAdminTestJSON-259051390 None] Deleted volume successfully. Sep 23 15:15:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cd2c3ee7-61f8-404b-8e6d-44c1c328addb tempest-VolumesListAdminTestJSON-452256953 None] Acquiring lock "cinder-quobyte-c8ee2572-4c81-4e5f-9d5b-cb7790820c96" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:15:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4e2fdc1c-7bea-4221-8b9d-d07dfe2cd512 tempest-VolumesListAdminTestJSON-259051390 None] Lock "cinder-f6936348-98a9-4124-bab3-ffb8e05262fb-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:15:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cd2c3ee7-61f8-404b-8e6d-44c1c328addb tempest-VolumesListAdminTestJSON-452256953 None] Lock "cinder-quobyte-c8ee2572-4c81-4e5f-9d5b-cb7790820c96" acquired by "delete_volume" :: waited 0.030s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:15:21 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6aa3c5d-17ca-43d6-915f-71f6d5a9787c]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:15:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cd2c3ee7-61f8-404b-8e6d-44c1c328addb tempest-VolumesListAdminTestJSON-452256953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c8ee2572-4c81-4e5f-9d5b-cb7790820c96 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:21 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c8ee2572-4c81-4e5f-9d5b-cb7790820c96 Sep 23 15:15:21 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:22 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cd2c3ee7-61f8-404b-8e6d-44c1c328addb tempest-VolumesListAdminTestJSON-452256953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c8ee2572-4c81-4e5f-9d5b-cb7790820c96" returned: 0 in 0.599s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cd2c3ee7-61f8-404b-8e6d-44c1c328addb tempest-VolumesListAdminTestJSON-452256953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c8ee2572-4c81-4e5f-9d5b-cb7790820c96 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:22 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c8ee2572-4c81-4e5f-9d5b-cb7790820c96 Sep 23 15:15:22 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:22 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cd2c3ee7-61f8-404b-8e6d-44c1c328addb tempest-VolumesListAdminTestJSON-452256953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c8ee2572-4c81-4e5f-9d5b-cb7790820c96" returned: 0 in 0.383s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cd2c3ee7-61f8-404b-8e6d-44c1c328addb tempest-VolumesListAdminTestJSON-452256953 None] Lock "cinder-quobyte-c8ee2572-4c81-4e5f-9d5b-cb7790820c96" released by "delete_volume" :: held 1.032s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:15:22 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-cd2c3ee7-61f8-404b-8e6d-44c1c328addb tempest-VolumesListAdminTestJSON-452256953 None] Created reservations ['a236f495-e8fd-44b4-bd35-1704b4110361', 'd53d25ba-5e1e-4aea-9f03-2d4d6c15cd70', '76d8f793-9fe2-4554-b442-e62f2a67fabf', 'd35ac328-73ac-4844-ac6e-5c3508e5fed4'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:15:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cd2c3ee7-61f8-404b-8e6d-44c1c328addb tempest-VolumesListAdminTestJSON-452256953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cd2c3ee7-61f8-404b-8e6d-44c1c328addb tempest-VolumesListAdminTestJSON-452256953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cd2c3ee7-61f8-404b-8e6d-44c1c328addb tempest-VolumesListAdminTestJSON-452256953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:15:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cd2c3ee7-61f8-404b-8e6d-44c1c328addb tempest-VolumesListAdminTestJSON-452256953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:15:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cd2c3ee7-61f8-404b-8e6d-44c1c328addb tempest-VolumesListAdminTestJSON-452256953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cd2c3ee7-61f8-404b-8e6d-44c1c328addb tempest-VolumesListAdminTestJSON-452256953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:22 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:15:22 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:22 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7d6f178f-605a-475d-a53c-0c1d18df3af1_88qqj9n6devstack@QuobyteHD, size 20.69 MB, duration 8.22 sec {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 15:15:22 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Image download 20.69 MB at 2.52 MB/s Sep 23 15:15:22 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cd2c3ee7-61f8-404b-8e6d-44c1c328addb tempest-VolumesListAdminTestJSON-452256953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.336s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:22 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-cd2c3ee7-61f8-404b-8e6d-44c1c328addb tempest-VolumesListAdminTestJSON-452256953 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:15:22 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-cd2c3ee7-61f8-404b-8e6d-44c1c328addb tempest-VolumesListAdminTestJSON-452256953 None] Deleted volume successfully. Sep 23 15:15:22 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c9b5ae-b81c-4d14-b6b3-638d839fae9d]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:15:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d6f178f-605a-475d-a53c-0c1d18df3af1_88qqj9n6devstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cd2c3ee7-61f8-404b-8e6d-44c1c328addb tempest-VolumesListAdminTestJSON-452256953 None] Lock "cinder-c8ee2572-4c81-4e5f-9d5b-cb7790820c96-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:15:23 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d6f178f-605a-475d-a53c-0c1d18df3af1_88qqj9n6devstack@QuobyteHD Sep 23 15:15:23 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:23 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d6f178f-605a-475d-a53c-0c1d18df3af1_88qqj9n6devstack@QuobyteHD" returned: 0 in 0.435s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:23 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Temporary image 7d6f178f-605a-475d-a53c-0c1d18df3af1 is fetched for user ff2bef0d2dd74e1d8d4a8fe4f95a0d09. {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 15:15:23 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a960f4-3e4d-4a85-80de-40181e0e1ef1]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:15:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d6f178f-605a-475d-a53c-0c1d18df3af1_88qqj9n6devstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cd978d35-d95a-4a7e-83cb-ff4b69d1ce36 tempest-VolumesListAdminTestJSON-452256953 None] Acquiring lock "cinder-5d9334bc-e377-4951-9213-351becdb2cba-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:15:23 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d6f178f-605a-475d-a53c-0c1d18df3af1_88qqj9n6devstack@QuobyteHD Sep 23 15:15:23 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cd978d35-d95a-4a7e-83cb-ff4b69d1ce36 tempest-VolumesListAdminTestJSON-452256953 None] Lock "cinder-5d9334bc-e377-4951-9213-351becdb2cba-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:15:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cd978d35-d95a-4a7e-83cb-ff4b69d1ce36 tempest-VolumesListAdminTestJSON-452256953 None] Acquiring lock "cinder-quobyte-5d9334bc-e377-4951-9213-351becdb2cba" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:15:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cd978d35-d95a-4a7e-83cb-ff4b69d1ce36 tempest-VolumesListAdminTestJSON-452256953 None] Lock "cinder-quobyte-5d9334bc-e377-4951-9213-351becdb2cba" acquired by "delete_volume" :: waited 0.019s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:15:23 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc62e255-6077-4df2-935a-e153b44bba77]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:15:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cd978d35-d95a-4a7e-83cb-ff4b69d1ce36 tempest-VolumesListAdminTestJSON-452256953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d9334bc-e377-4951-9213-351becdb2cba {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:24 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d9334bc-e377-4951-9213-351becdb2cba Sep 23 15:15:24 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:24 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d6f178f-605a-475d-a53c-0c1d18df3af1_88qqj9n6devstack@QuobyteHD" returned: 0 in 0.518s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1084448348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26787467-14fb-4099-88ff-5d72fc3ec25e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a5cf9d21424c7f8a6ee86f2c1a73f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:14Z,use_quota=True,user_id='ff2bef0d2dd74e1d8d4a8fe4f95a0d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e8c14e6-ba07-4d86-b596-a084608a9f88),volume_type_id=1e8c14e6-ba07-4d86-b596-a084608a9f88)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Creating volume 26787467-14fb-4099-88ff-5d72fc3ec25e {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:15:24 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-26787467-14fb-4099-88ff-5d72fc3ec25e 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:24 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-26787467-14fb-4099-88ff-5d72fc3ec25e 1073741824 Sep 23 15:15:24 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:24 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cd978d35-d95a-4a7e-83cb-ff4b69d1ce36 tempest-VolumesListAdminTestJSON-452256953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d9334bc-e377-4951-9213-351becdb2cba" returned: 0 in 0.529s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cd978d35-d95a-4a7e-83cb-ff4b69d1ce36 tempest-VolumesListAdminTestJSON-452256953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d9334bc-e377-4951-9213-351becdb2cba {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:24 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d9334bc-e377-4951-9213-351becdb2cba Sep 23 15:15:24 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:24 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-26787467-14fb-4099-88ff-5d72fc3ec25e 1073741824" returned: 0 in 0.547s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-26787467-14fb-4099-88ff-5d72fc3ec25e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:24 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cd978d35-d95a-4a7e-83cb-ff4b69d1ce36 tempest-VolumesListAdminTestJSON-452256953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d9334bc-e377-4951-9213-351becdb2cba" returned: 0 in 0.305s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cd978d35-d95a-4a7e-83cb-ff4b69d1ce36 tempest-VolumesListAdminTestJSON-452256953 None] Lock "cinder-quobyte-5d9334bc-e377-4951-9213-351becdb2cba" released by "delete_volume" :: held 0.889s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:15:24 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-26787467-14fb-4099-88ff-5d72fc3ec25e Sep 23 15:15:24 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-cd978d35-d95a-4a7e-83cb-ff4b69d1ce36 tempest-VolumesListAdminTestJSON-452256953 None] Created reservations ['41a893f4-7aee-4f5f-9223-e38e3eaf995e', 'e086f8eb-403c-44bc-90fb-15d5702ed243', '88feaf92-c0f6-45dc-b572-3a89ed87abe6', 'e3614244-ab93-4199-b4de-55342b06cd55'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cd978d35-d95a-4a7e-83cb-ff4b69d1ce36 tempest-VolumesListAdminTestJSON-452256953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cd978d35-d95a-4a7e-83cb-ff4b69d1ce36 tempest-VolumesListAdminTestJSON-452256953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cd978d35-d95a-4a7e-83cb-ff4b69d1ce36 tempest-VolumesListAdminTestJSON-452256953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cd978d35-d95a-4a7e-83cb-ff4b69d1ce36 tempest-VolumesListAdminTestJSON-452256953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cd978d35-d95a-4a7e-83cb-ff4b69d1ce36 tempest-VolumesListAdminTestJSON-452256953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cd978d35-d95a-4a7e-83cb-ff4b69d1ce36 tempest-VolumesListAdminTestJSON-452256953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:25 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:15:25 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:25 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-26787467-14fb-4099-88ff-5d72fc3ec25e" returned: 0 in 0.481s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:15:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:25 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Attempting download of 7d6f178f-605a-475d-a53c-0c1d18df3af1 ((None, [{'url': 'file:///opt/stack/data/glance/images/7d6f178f-605a-475d-a53c-0c1d18df3af1', 'metadata': {}}])) to volume 26787467-14fb-4099-88ff-5d72fc3ec25e. {{(pid=86064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 15:15:25 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e625b8b7-1fcb-4dad-8208-b0e81995307e]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:15:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d6f178f-605a-475d-a53c-0c1d18df3af1_qcne0oya {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:25 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cd978d35-d95a-4a7e-83cb-ff4b69d1ce36 tempest-VolumesListAdminTestJSON-452256953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.533s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:25 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-cd978d35-d95a-4a7e-83cb-ff4b69d1ce36 tempest-VolumesListAdminTestJSON-452256953 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:15:25 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-cd978d35-d95a-4a7e-83cb-ff4b69d1ce36 tempest-VolumesListAdminTestJSON-452256953 None] Deleted volume successfully. Sep 23 15:15:25 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cd978d35-d95a-4a7e-83cb-ff4b69d1ce36 tempest-VolumesListAdminTestJSON-452256953 None] Lock "cinder-5d9334bc-e377-4951-9213-351becdb2cba-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:15:25 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d6f178f-605a-475d-a53c-0c1d18df3af1_qcne0oya Sep 23 15:15:25 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:25 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d6f178f-605a-475d-a53c-0c1d18df3af1_qcne0oya" returned: 0 in 0.543s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d6f178f-605a-475d-a53c-0c1d18df3af1_qcne0oya {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:26 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d6f178f-605a-475d-a53c-0c1d18df3af1_qcne0oya Sep 23 15:15:26 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:26 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d6f178f-605a-475d-a53c-0c1d18df3af1_qcne0oya" returned: 1 in 0.397s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d6f178f-605a-475d-a53c-0c1d18df3af1_qcne0oya' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:15:26 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[79003010-8c92-44f0-bad8-de719fe8a388]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:15:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d6f178f-605a-475d-a53c-0c1d18df3af1_88qqj9n6devstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:26 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d6f178f-605a-475d-a53c-0c1d18df3af1_88qqj9n6devstack@QuobyteHD Sep 23 15:15:26 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:26 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d6f178f-605a-475d-a53c-0c1d18df3af1_88qqj9n6devstack@QuobyteHD" returned: 0 in 0.511s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:26 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] 7d6f178f-605a-475d-a53c-0c1d18df3af1 was qcow2, converting to qcow2 {{(pid=86064) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 15:15:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7d6f178f-605a-475d-a53c-0c1d18df3af1_88qqj9n6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-26787467-14fb-4099-88ff-5d72fc3ec25e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:26 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7d6f178f-605a-475d-a53c-0c1d18df3af1_88qqj9n6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-26787467-14fb-4099-88ff-5d72fc3ec25e Sep 23 15:15:26 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:29 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7d6f178f-605a-475d-a53c-0c1d18df3af1_88qqj9n6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-26787467-14fb-4099-88ff-5d72fc3ec25e" returned: 0 in 2.720s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:29 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7d6f178f-605a-475d-a53c-0c1d18df3af1_88qqj9n6devstack@QuobyteHD, size 112.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-26787467-14fb-4099-88ff-5d72fc3ec25e {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:15:29 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Converted 112.00 MB image at 41.16 MB/s Sep 23 15:15:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-26787467-14fb-4099-88ff-5d72fc3ec25e 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:29 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-26787467-14fb-4099-88ff-5d72fc3ec25e 1G Sep 23 15:15:29 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:30 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-26787467-14fb-4099-88ff-5d72fc3ec25e 1G" returned: 0 in 0.462s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:30 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Downloaded image 7d6f178f-605a-475d-a53c-0c1d18df3af1 ((None, [{'url': 'file:///opt/stack/data/glance/images/7d6f178f-605a-475d-a53c-0c1d18df3af1', 'metadata': {}}])) to volume 26787467-14fb-4099-88ff-5d72fc3ec25e successfully. {{(pid=86064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 15:15:30 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Temporary image 7d6f178f-605a-475d-a53c-0c1d18df3af1 for user ff2bef0d2dd74e1d8d4a8fe4f95a0d09 is deleted. {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 15:15:30 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Marking volume 26787467-14fb-4099-88ff-5d72fc3ec25e as bootable. {{(pid=86064) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 15:15:30 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Copying metadata from image 7d6f178f-605a-475d-a53c-0c1d18df3af1 to 26787467-14fb-4099-88ff-5d72fc3ec25e. {{(pid=86064) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 15:15:30 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Creating volume glance metadata for volume 26787467-14fb-4099-88ff-5d72fc3ec25e backed by image 7d6f178f-605a-475d-a53c-0c1d18df3af1 with: {'image_id': '7d6f178f-605a-475d-a53c-0c1d18df3af1', 'image_name': 'tempest-scenario-img--790021402', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86064) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 15:15:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b156161-b28b-4bc0-bf7b-5f2d73fb9384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26787467-14fb-4099-88ff-5d72fc3ec25e', 'volume_size': 1, 'image_id': '7d6f178f-605a-475d-a53c-0c1d18df3af1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d6f178f-605a-475d-a53c-0c1d18df3af1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--790021402', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '07a5cf9d21424c7f8a6ee86f2c1a73f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7d6f178f-605a-475d-a53c-0c1d18df3af1', 'created_at': datetime.datetime(2026, 9, 23, 13, 15, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 15, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d6f178f-605a-475d-a53c-0c1d18df3af1/file', 'properties': {}}, 'image_service': }' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb942582-9a2a-4215-9023-d8855c1613fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:30 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Volume volume-26787467-14fb-4099-88ff-5d72fc3ec25e (26787467-14fb-4099-88ff-5d72fc3ec25e): created successfully Sep 23 15:15:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb942582-9a2a-4215-9023-d8855c1613fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Flow 'volume_create_manager' (e13a6d56-7a32-4a10-80ba-ca7005b29860) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:30 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f608b61e-d470-4f87-a4b1-1d77c7997769 tempest-TestInstancesWithCinderVolumes-255478537 None] Created volume successfully. Sep 23 15:15:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-41343797-9055-4cfb-8c32-afaf2d392bd2 req-750321e3-2a8a-40eb-b70a-1869263d4517 tempest-TestInstancesWithCinderVolumes-255478537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-41343797-9055-4cfb-8c32-afaf2d392bd2 req-750321e3-2a8a-40eb-b70a-1869263d4517 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-41343797-9055-4cfb-8c32-afaf2d392bd2 req-750321e3-2a8a-40eb-b70a-1869263d4517 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-41343797-9055-4cfb-8c32-afaf2d392bd2 req-750321e3-2a8a-40eb-b70a-1869263d4517 tempest-TestInstancesWithCinderVolumes-255478537 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-26787467-14fb-4099-88ff-5d72fc3ec25e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3feef35c-1aa2-44e5-9c2b-1b577c6ac5f7', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:15:34 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-41343797-9055-4cfb-8c32-afaf2d392bd2 req-750321e3-2a8a-40eb-b70a-1869263d4517 tempest-TestInstancesWithCinderVolumes-255478537 None] attachment_update completed successfully. Sep 23 15:15:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:15:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:15:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:15:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:36 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:15:36 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:36 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.366s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:15:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:15:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 28 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:15:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:15:39 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:15:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Flow 'volume_create_manager' (4f13b5fd-18be-44f8-b561-5ece4d3715db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b0a3da-bf27-4810-93a6-ab1c0f04fcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b0a3da-bf27-4810-93a6-ab1c0f04fcec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-59775124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e60762d-2d62-4745-b4f7-94b9c213c0cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de9ff523c6a4c838226da0614bdbb01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:40Z,use_quota=True,user_id='98ae6a79dc764289a187c8b272644730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd4a9c5-57b5-480f-b77b-7916e093bfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd4a9c5-57b5-480f-b77b-7916e093bfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51251f09-ffca-4908-a80a-faebd7658508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51251f09-ffca-4908-a80a-faebd7658508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e60762d-2d62-4745-b4f7-94b9c213c0cc', 'volume_name': 'volume-4e60762d-2d62-4745-b4f7-94b9c213c0cc', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (162e20e3-975d-403d-a3d1-10e8dc6d00a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (162e20e3-975d-403d-a3d1-10e8dc6d00a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bd5fc7-f4b7-422d-901c-25acf426b976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:39 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Volume 4e60762d-2d62-4745-b4f7-94b9c213c0cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e60762d-2d62-4745-b4f7-94b9c213c0cc', 'volume_size': 1} Sep 23 15:15:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-59775124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e60762d-2d62-4745-b4f7-94b9c213c0cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de9ff523c6a4c838226da0614bdbb01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:40Z,use_quota=True,user_id='98ae6a79dc764289a187c8b272644730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:15:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Creating volume 4e60762d-2d62-4745-b4f7-94b9c213c0cc {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:15:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:15:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:15:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:15:39 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:15:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e60762d-2d62-4745-b4f7-94b9c213c0cc 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:39 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e60762d-2d62-4745-b4f7-94b9c213c0cc 1073741824 Sep 23 15:15:39 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:40 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e60762d-2d62-4745-b4f7-94b9c213c0cc 1073741824" returned: 0 in 0.811s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e60762d-2d62-4745-b4f7-94b9c213c0cc {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:40 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e60762d-2d62-4745-b4f7-94b9c213c0cc Sep 23 15:15:40 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:41 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e60762d-2d62-4745-b4f7-94b9c213c0cc" returned: 0 in 0.640s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bd5fc7-f4b7-422d-901c-25acf426b976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e60762d-2d62-4745-b4f7-94b9c213c0cc', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f580a9-600a-40cd-95aa-4d4756605409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:41 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Volume volume-4e60762d-2d62-4745-b4f7-94b9c213c0cc (4e60762d-2d62-4745-b4f7-94b9c213c0cc): created successfully Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f580a9-600a-40cd-95aa-4d4756605409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Flow 'volume_create_manager' (4f13b5fd-18be-44f8-b561-5ece4d3715db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Flow 'volume_create_manager' (d5ee4dc4-c3de-435a-a0a8-cb96e91a12bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ceab5a-e3a3-454a-865e-c0abb32fc6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:41 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5718e0bc-9377-4daa-a93e-96e01fd5878c tempest-VolumesTransfersTest-2079108163 None] Created volume successfully. Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ceab5a-e3a3-454a-865e-c0abb32fc6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1238858600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ea9fde-b082-460e-8c74-cf0390a45c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ad7a3651d14753914140d3aa290ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:41Z,use_quota=True,user_id='8ec2ca8a1c2a4a30a051aa0ca7d882e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5217511-daaa-4881-8bd8-1d99aa9ad5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5217511-daaa-4881-8bd8-1d99aa9ad5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd36c0e6-cf95-4855-8e45-0affbb391c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd36c0e6-cf95-4855-8e45-0affbb391c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55ea9fde-b082-460e-8c74-cf0390a45c3b', 'volume_name': 'volume-55ea9fde-b082-460e-8c74-cf0390a45c3b', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88cec56-b030-49e8-b9d1-317c19714a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88cec56-b030-49e8-b9d1-317c19714a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e27e6d-1ff3-41e2-b620-a24f2d394ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:41 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Volume 55ea9fde-b082-460e-8c74-cf0390a45c3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55ea9fde-b082-460e-8c74-cf0390a45c3b', 'volume_size': 1} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1238858600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ea9fde-b082-460e-8c74-cf0390a45c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ad7a3651d14753914140d3aa290ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:41Z,use_quota=True,user_id='8ec2ca8a1c2a4a30a051aa0ca7d882e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Creating volume 55ea9fde-b082-460e-8c74-cf0390a45c3b {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:15:41 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:15:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-55ea9fde-b082-460e-8c74-cf0390a45c3b 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:41 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-55ea9fde-b082-460e-8c74-cf0390a45c3b 1073741824 Sep 23 15:15:41 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:42 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-55ea9fde-b082-460e-8c74-cf0390a45c3b 1073741824" returned: 0 in 0.871s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-55ea9fde-b082-460e-8c74-cf0390a45c3b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:42 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-55ea9fde-b082-460e-8c74-cf0390a45c3b Sep 23 15:15:42 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:43 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-55ea9fde-b082-460e-8c74-cf0390a45c3b" returned: 0 in 0.543s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:43 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:15:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:43 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e27e6d-1ff3-41e2-b620-a24f2d394ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55ea9fde-b082-460e-8c74-cf0390a45c3b', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:43 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85433be0-940a-47a7-825f-4934800a8a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:43 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Volume volume-55ea9fde-b082-460e-8c74-cf0390a45c3b (55ea9fde-b082-460e-8c74-cf0390a45c3b): created successfully Sep 23 15:15:43 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85433be0-940a-47a7-825f-4934800a8a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:43 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Flow 'volume_create_manager' (d5ee4dc4-c3de-435a-a0a8-cb96e91a12bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:43 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7433ef15-51c4-4087-8b54-89177e4b5199 tempest-AttachVolumeTestJSON-1693410156 None] Created volume successfully. Sep 23 15:15:43 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-3a15441c-7f3f-4ad8-95c1-a1fe6e8b7c74 tempest-VolumesTransfersTest-1545520923 None] Transfer volume completed successfully. Sep 23 15:15:44 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2edf4188-3452-47ac-9ec6-1428ed0781a8 tempest-VolumesTransfersTest-1747295932 None] Acquiring lock "cinder-4e60762d-2d62-4745-b4f7-94b9c213c0cc-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:15:44 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2edf4188-3452-47ac-9ec6-1428ed0781a8 tempest-VolumesTransfersTest-1747295932 None] Lock "cinder-4e60762d-2d62-4745-b4f7-94b9c213c0cc-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:15:44 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2edf4188-3452-47ac-9ec6-1428ed0781a8 tempest-VolumesTransfersTest-1747295932 None] Acquiring lock "cinder-quobyte-4e60762d-2d62-4745-b4f7-94b9c213c0cc" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:15:44 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2edf4188-3452-47ac-9ec6-1428ed0781a8 tempest-VolumesTransfersTest-1747295932 None] Lock "cinder-quobyte-4e60762d-2d62-4745-b4f7-94b9c213c0cc" acquired by "delete_volume" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:15:44 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8180a484-33dd-4744-b364-f241c29acba1]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:15:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2edf4188-3452-47ac-9ec6-1428ed0781a8 tempest-VolumesTransfersTest-1747295932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e60762d-2d62-4745-b4f7-94b9c213c0cc {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:45 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e60762d-2d62-4745-b4f7-94b9c213c0cc Sep 23 15:15:45 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-0fb26e78-5e8b-41ef-bffb-06b09cb29233 req-d11abdfc-130e-4f57-98a1-4558c5b81f4d tempest-AttachVolumeTestJSON-1693410156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-0fb26e78-5e8b-41ef-bffb-06b09cb29233 req-d11abdfc-130e-4f57-98a1-4558c5b81f4d tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-0fb26e78-5e8b-41ef-bffb-06b09cb29233 req-d11abdfc-130e-4f57-98a1-4558c5b81f4d tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-0fb26e78-5e8b-41ef-bffb-06b09cb29233 req-d11abdfc-130e-4f57-98a1-4558c5b81f4d tempest-AttachVolumeTestJSON-1693410156 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-55ea9fde-b082-460e-8c74-cf0390a45c3b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7c0c973-d90a-4ef2-b05c-8d01d2ec7a36', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:15:45 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-0fb26e78-5e8b-41ef-bffb-06b09cb29233 req-d11abdfc-130e-4f57-98a1-4558c5b81f4d tempest-AttachVolumeTestJSON-1693410156 None] attachment_update completed successfully. Sep 23 15:15:45 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2edf4188-3452-47ac-9ec6-1428ed0781a8 tempest-VolumesTransfersTest-1747295932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e60762d-2d62-4745-b4f7-94b9c213c0cc" returned: 0 in 0.699s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2edf4188-3452-47ac-9ec6-1428ed0781a8 tempest-VolumesTransfersTest-1747295932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e60762d-2d62-4745-b4f7-94b9c213c0cc {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:45 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e60762d-2d62-4745-b4f7-94b9c213c0cc Sep 23 15:15:45 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:46 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2edf4188-3452-47ac-9ec6-1428ed0781a8 tempest-VolumesTransfersTest-1747295932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e60762d-2d62-4745-b4f7-94b9c213c0cc" returned: 0 in 0.799s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2edf4188-3452-47ac-9ec6-1428ed0781a8 tempest-VolumesTransfersTest-1747295932 None] Lock "cinder-quobyte-4e60762d-2d62-4745-b4f7-94b9c213c0cc" released by "delete_volume" :: held 1.589s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:15:46 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-2edf4188-3452-47ac-9ec6-1428ed0781a8 tempest-VolumesTransfersTest-1747295932 None] Created reservations ['f8123384-f224-44ae-a127-b359509c278a', 'ab412436-82a1-41d5-a3f5-c9e40088804d', 'db02cc89-f72a-4019-8800-9a8a5465680e', '837aec68-c288-414c-8f7e-94dba3efa54e'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:15:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2edf4188-3452-47ac-9ec6-1428ed0781a8 tempest-VolumesTransfersTest-1747295932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2edf4188-3452-47ac-9ec6-1428ed0781a8 tempest-VolumesTransfersTest-1747295932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2edf4188-3452-47ac-9ec6-1428ed0781a8 tempest-VolumesTransfersTest-1747295932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:15:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2edf4188-3452-47ac-9ec6-1428ed0781a8 tempest-VolumesTransfersTest-1747295932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:15:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2edf4188-3452-47ac-9ec6-1428ed0781a8 tempest-VolumesTransfersTest-1747295932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2edf4188-3452-47ac-9ec6-1428ed0781a8 tempest-VolumesTransfersTest-1747295932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:46 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:15:46 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:47 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2edf4188-3452-47ac-9ec6-1428ed0781a8 tempest-VolumesTransfersTest-1747295932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.650s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:47 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-2edf4188-3452-47ac-9ec6-1428ed0781a8 tempest-VolumesTransfersTest-1747295932 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:15:47 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-2edf4188-3452-47ac-9ec6-1428ed0781a8 tempest-VolumesTransfersTest-1747295932 None] Deleted volume successfully. Sep 23 15:15:47 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2edf4188-3452-47ac-9ec6-1428ed0781a8 tempest-VolumesTransfersTest-1747295932 None] Lock "cinder-4e60762d-2d62-4745-b4f7-94b9c213c0cc-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Flow 'volume_create_manager' (2dd470b7-5deb-4253-aadd-b5828a1a4c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3765aff4-610a-479a-9d40-88875590bc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3765aff4-610a-479a-9d40-88875590bc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-749953658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b23aa2-c571-4023-b3b6-6959a1a30f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de9ff523c6a4c838226da0614bdbb01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:48Z,use_quota=True,user_id='98ae6a79dc764289a187c8b272644730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f228de-c4f1-4822-a537-cf077de0a15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f228de-c4f1-4822-a537-cf077de0a15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a5bd5b-2afb-4a23-9845-6b403c75c1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a5bd5b-2afb-4a23-9845-6b403c75c1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4b23aa2-c571-4023-b3b6-6959a1a30f61', 'volume_name': 'volume-c4b23aa2-c571-4023-b3b6-6959a1a30f61', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (254a4c8b-f1d6-45a4-a2cd-0b4f1949652b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (254a4c8b-f1d6-45a4-a2cd-0b4f1949652b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df17b709-61d2-479c-91c3-c7290a228905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:48 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Volume c4b23aa2-c571-4023-b3b6-6959a1a30f61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4b23aa2-c571-4023-b3b6-6959a1a30f61', 'volume_size': 1} Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-749953658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b23aa2-c571-4023-b3b6-6959a1a30f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de9ff523c6a4c838226da0614bdbb01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:48Z,use_quota=True,user_id='98ae6a79dc764289a187c8b272644730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Creating volume c4b23aa2-c571-4023-b3b6-6959a1a30f61 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:15:48 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4b23aa2-c571-4023-b3b6-6959a1a30f61 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:48 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4b23aa2-c571-4023-b3b6-6959a1a30f61 1073741824 Sep 23 15:15:48 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:48 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4b23aa2-c571-4023-b3b6-6959a1a30f61 1073741824" returned: 0 in 0.543s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:48 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Flow 'volume_create_manager' (eafde818-541a-4acd-a40f-95dade2c730e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44e4294-c0ed-4716-a304-b00f56476fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4b23aa2-c571-4023-b3b6-6959a1a30f61 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44e4294-c0ed-4716-a304-b00f56476fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-265120145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35ad1ca-e419-4a5b-a1b2-7fc88de73665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08dbb22a48c24213aff722f7cac5e1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:49Z,use_quota=True,user_id='d43ba224e8a14850998f0b889ca1a39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:49 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4b23aa2-c571-4023-b3b6-6959a1a30f61 Sep 23 15:15:49 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc4ff54-299f-4595-98d2-3ea78a0cdedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc4ff54-299f-4595-98d2-3ea78a0cdedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7782a866-e448-4488-8768-eb68bae5dd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.image.glance [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Creating Keystone auth plugin from conf {{(pid=86064) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Flow 'volume_create_manager' (645d5a09-4cb6-44ec-8d73-836a35674b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc5dbfea-d36b-4be5-87c7-d842b72d37d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc5dbfea-d36b-4be5-87c7-d842b72d37d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-977310542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9839ec0-4c5b-457c-8264-b958f849923a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ad7a3651d14753914140d3aa290ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:49Z,use_quota=True,user_id='8ec2ca8a1c2a4a30a051aa0ca7d882e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ceb632-7753-48f4-bb12-097c98c50501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ceb632-7753-48f4-bb12-097c98c50501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d4757f-3475-4593-8b61-a2ca094a2346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d4757f-3475-4593-8b61-a2ca094a2346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9839ec0-4c5b-457c-8264-b958f849923a', 'volume_name': 'volume-a9839ec0-4c5b-457c-8264-b958f849923a', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c70be95-edaf-4f2d-8ce6-8c74d71bfa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c70be95-edaf-4f2d-8ce6-8c74d71bfa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66ea52bb-4f06-4641-b3ee-4b58259c0ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:49 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Volume a9839ec0-4c5b-457c-8264-b958f849923a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9839ec0-4c5b-457c-8264-b958f849923a', 'volume_size': 1} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:49 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4b23aa2-c571-4023-b3b6-6959a1a30f61" returned: 0 in 0.322s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.078s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-977310542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9839ec0-4c5b-457c-8264-b958f849923a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ad7a3651d14753914140d3aa290ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:49Z,use_quota=True,user_id='8ec2ca8a1c2a4a30a051aa0ca7d882e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Creating volume a9839ec0-4c5b-457c-8264-b958f849923a {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:15:49 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a9839ec0-4c5b-457c-8264-b958f849923a 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:49 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a9839ec0-4c5b-457c-8264-b958f849923a 1073741824 Sep 23 15:15:49 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df17b709-61d2-479c-91c3-c7290a228905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4b23aa2-c571-4023-b3b6-6959a1a30f61', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae47077-067b-4bdf-832a-b48868388454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:49 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Volume volume-c4b23aa2-c571-4023-b3b6-6959a1a30f61 (c4b23aa2-c571-4023-b3b6-6959a1a30f61): created successfully Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae47077-067b-4bdf-832a-b48868388454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Flow 'volume_create_manager' (2dd470b7-5deb-4253-aadd-b5828a1a4c24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:49 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-e6196e13-74b9-4670-a2b5-e209ce2cd922 tempest-VolumesTransfersTest-2079108163 None] Created volume successfully. Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7782a866-e448-4488-8768-eb68bae5dd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b35ad1ca-e419-4a5b-a1b2-7fc88de73665', 'volume_name': 'volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665', 'volume_size': 1, 'image_id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6096e44b8882450f8963b9e995032e95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'created_at': datetime.datetime(2026, 9, 23, 13, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e612db8e-4d33-469a-9b98-e7920f09b036/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae9cb3d-dd59-4158-a564-8a3570bc5240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae9cb3d-dd59-4158-a564-8a3570bc5240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead8d2b8-043f-45c4-b735-9f9acec12952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:49 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Volume b35ad1ca-e419-4a5b-a1b2-7fc88de73665: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665', 'volume_size': 1, 'image_id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6096e44b8882450f8963b9e995032e95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'created_at': datetime.datetime(2026, 9, 23, 13, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e612db8e-4d33-469a-9b98-e7920f09b036/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 15:15:49 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Trying to clone b35ad1ca-e419-4a5b-a1b2-7fc88de73665 from image e612db8e-4d33-469a-9b98-e7920f09b036 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}]). {{(pid=86064) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 15:15:50 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_wir8pt6vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 15:15:50 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Image download 20.69 MB at 20.69 MB/s Sep 23 15:15:50 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[84996a43-22fa-4c73-a0b3-eb38f8f11ddc]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:15:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_wir8pt6vdevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:50 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a9839ec0-4c5b-457c-8264-b958f849923a 1073741824" returned: 0 in 0.771s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a9839ec0-4c5b-457c-8264-b958f849923a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:50 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a9839ec0-4c5b-457c-8264-b958f849923a Sep 23 15:15:50 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:50 devstack sudo[97290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_wir8pt6vdevstack@QuobyteHD Sep 23 15:15:50 devstack sudo[97290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:50 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a9839ec0-4c5b-457c-8264-b958f849923a" returned: 0 in 0.307s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:50 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:15:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66ea52bb-4f06-4641-b3ee-4b58259c0ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9839ec0-4c5b-457c-8264-b958f849923a', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d797d79-a20a-4e21-bb2d-d7b7e61c313c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:50 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Volume volume-a9839ec0-4c5b-457c-8264-b958f849923a (a9839ec0-4c5b-457c-8264-b958f849923a): created successfully Sep 23 15:15:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d797d79-a20a-4e21-bb2d-d7b7e61c313c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:50 devstack sudo[97290]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Flow 'volume_create_manager' (645d5a09-4cb6-44ec-8d73-836a35674b7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_wir8pt6vdevstack@QuobyteHD" returned: 0 in 0.485s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:50 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Temporary image e612db8e-4d33-469a-9b98-e7920f09b036 is fetched for user d43ba224e8a14850998f0b889ca1a39d. {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 15:15:50 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-b1458233-fe4e-4b58-837c-3a80a255e918 tempest-AttachVolumeTestJSON-1693410156 None] Created volume successfully. Sep 23 15:15:50 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3e726f-f425-4ddf-a8cb-784ffd74c0b2]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:15:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_wir8pt6vdevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:50 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_wir8pt6vdevstack@QuobyteHD Sep 23 15:15:50 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:51 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-58a5ef1c-3f0e-4005-90c6-22108d3c4ec1 tempest-VolumesTransfersTest-1747295932 None] Acquiring lock "cinder-c4b23aa2-c571-4023-b3b6-6959a1a30f61-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:15:51 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-58a5ef1c-3f0e-4005-90c6-22108d3c4ec1 tempest-VolumesTransfersTest-1747295932 None] Lock "cinder-c4b23aa2-c571-4023-b3b6-6959a1a30f61-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:15:51 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-58a5ef1c-3f0e-4005-90c6-22108d3c4ec1 tempest-VolumesTransfersTest-1747295932 None] Acquiring lock "cinder-quobyte-c4b23aa2-c571-4023-b3b6-6959a1a30f61" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:15:51 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-58a5ef1c-3f0e-4005-90c6-22108d3c4ec1 tempest-VolumesTransfersTest-1747295932 None] Lock "cinder-quobyte-c4b23aa2-c571-4023-b3b6-6959a1a30f61" acquired by "delete_volume" :: waited 0.035s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:15:51 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_wir8pt6vdevstack@QuobyteHD" returned: 0 in 0.762s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-265120145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35ad1ca-e419-4a5b-a1b2-7fc88de73665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08dbb22a48c24213aff722f7cac5e1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:15:49Z,use_quota=True,user_id='d43ba224e8a14850998f0b889ca1a39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:15:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Creating volume b35ad1ca-e419-4a5b-a1b2-7fc88de73665 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:15:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:15:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:15:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:15:51 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:15:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:51 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a8da05-404f-4d13-9ae6-7d134da2773d]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:15:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-58a5ef1c-3f0e-4005-90c6-22108d3c4ec1 tempest-VolumesTransfersTest-1747295932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4b23aa2-c571-4023-b3b6-6959a1a30f61 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:51 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665 1073741824 Sep 23 15:15:51 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:51 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4b23aa2-c571-4023-b3b6-6959a1a30f61 Sep 23 15:15:51 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:52 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-58a5ef1c-3f0e-4005-90c6-22108d3c4ec1 tempest-VolumesTransfersTest-1747295932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4b23aa2-c571-4023-b3b6-6959a1a30f61" returned: 0 in 0.769s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-58a5ef1c-3f0e-4005-90c6-22108d3c4ec1 tempest-VolumesTransfersTest-1747295932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4b23aa2-c571-4023-b3b6-6959a1a30f61 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:52 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4b23aa2-c571-4023-b3b6-6959a1a30f61 Sep 23 15:15:52 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-385f210b-0c40-41e2-b7f1-bd3685a75b86 req-632373de-9777-4826-bc9e-12644d3a899e tempest-AttachVolumeTestJSON-1693410156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:52 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665 1073741824" returned: 0 in 0.883s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:52 devstack sudo[97328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665 Sep 23 15:15:52 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:52 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-58a5ef1c-3f0e-4005-90c6-22108d3c4ec1 tempest-VolumesTransfersTest-1747295932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4b23aa2-c571-4023-b3b6-6959a1a30f61" returned: 0 in 0.392s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:52 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-58a5ef1c-3f0e-4005-90c6-22108d3c4ec1 tempest-VolumesTransfersTest-1747295932 None] Lock "cinder-quobyte-c4b23aa2-c571-4023-b3b6-6959a1a30f61" released by "delete_volume" :: held 1.269s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:15:52 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665" returned: 0 in 0.321s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:15:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-385f210b-0c40-41e2-b7f1-bd3685a75b86 req-632373de-9777-4826-bc9e-12644d3a899e tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.392s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-385f210b-0c40-41e2-b7f1-bd3685a75b86 req-632373de-9777-4826-bc9e-12644d3a899e tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:52 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-58a5ef1c-3f0e-4005-90c6-22108d3c4ec1 tempest-VolumesTransfersTest-1747295932 None] Created reservations ['702904f5-b631-4685-85ab-7709f26ffd9f', '62d78c01-4243-4ef2-92c5-c600332b9514', '1597b151-2bea-4a22-974c-1e40579626de', '73a84fea-0c59-45c6-9431-a0b2a25d3097'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:15:52 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Attempting download of e612db8e-4d33-469a-9b98-e7920f09b036 ((None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}])) to volume b35ad1ca-e419-4a5b-a1b2-7fc88de73665. {{(pid=86064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 15:15:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-385f210b-0c40-41e2-b7f1-bd3685a75b86 req-632373de-9777-4826-bc9e-12644d3a899e tempest-AttachVolumeTestJSON-1693410156 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-a9839ec0-4c5b-457c-8264-b958f849923a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee0ec26c-42bd-4065-b291-ff963a93c74e', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:15:52 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee9e767-98be-4578-9613-2a7a624b2413]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:15:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_hc7ojy24 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-58a5ef1c-3f0e-4005-90c6-22108d3c4ec1 tempest-VolumesTransfersTest-1747295932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:15:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-58a5ef1c-3f0e-4005-90c6-22108d3c4ec1 tempest-VolumesTransfersTest-1747295932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:15:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-58a5ef1c-3f0e-4005-90c6-22108d3c4ec1 tempest-VolumesTransfersTest-1747295932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:15:53 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-58a5ef1c-3f0e-4005-90c6-22108d3c4ec1 tempest-VolumesTransfersTest-1747295932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:15:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-58a5ef1c-3f0e-4005-90c6-22108d3c4ec1 tempest-VolumesTransfersTest-1747295932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:15:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-58a5ef1c-3f0e-4005-90c6-22108d3c4ec1 tempest-VolumesTransfersTest-1747295932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:53 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-385f210b-0c40-41e2-b7f1-bd3685a75b86 req-632373de-9777-4826-bc9e-12644d3a899e tempest-AttachVolumeTestJSON-1693410156 None] attachment_update completed successfully. Sep 23 15:15:53 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:15:53 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:53 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_hc7ojy24 Sep 23 15:15:53 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:53 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-58a5ef1c-3f0e-4005-90c6-22108d3c4ec1 tempest-VolumesTransfersTest-1747295932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.375s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:53 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-58a5ef1c-3f0e-4005-90c6-22108d3c4ec1 tempest-VolumesTransfersTest-1747295932 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:15:53 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-58a5ef1c-3f0e-4005-90c6-22108d3c4ec1 tempest-VolumesTransfersTest-1747295932 None] Deleted volume successfully. Sep 23 15:15:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-58a5ef1c-3f0e-4005-90c6-22108d3c4ec1 tempest-VolumesTransfersTest-1747295932 None] Lock "cinder-c4b23aa2-c571-4023-b3b6-6959a1a30f61-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:15:53 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_hc7ojy24" returned: 0 in 0.555s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_hc7ojy24 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:53 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_hc7ojy24 Sep 23 15:15:53 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:53 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_hc7ojy24" returned: 1 in 0.468s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_hc7ojy24' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:15:53 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f36f03-ac7d-4ad9-8c8d-049577bc59af]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:15:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_wir8pt6vdevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:54 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_wir8pt6vdevstack@QuobyteHD Sep 23 15:15:54 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:54 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_wir8pt6vdevstack@QuobyteHD" returned: 0 in 0.484s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:54 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] e612db8e-4d33-469a-9b98-e7920f09b036 was qcow2, converting to qcow2 {{(pid=86064) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 15:15:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_wir8pt6vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:54 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_wir8pt6vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665 Sep 23 15:15:54 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:55 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-6e0a0e71-aa2b-48f5-bb32-161da445b47e req-d661cccb-d180-43a6-bb24-4d16714aa3d7 tempest-AttachVolumeTestJSON-1693410156 None] Terminate volume connection completed successfully. Sep 23 15:15:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-6e0a0e71-aa2b-48f5-bb32-161da445b47e req-d661cccb-d180-43a6-bb24-4d16714aa3d7 tempest-AttachVolumeTestJSON-1693410156 None] Deleting attachment f7c0c973-d90a-4ef2-b05c-8d01d2ec7a36. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:15:56 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-8baaafd4-ec3c-4fb9-ae9c-b7e924fae411 req-22b0786a-7a25-46a8-9586-db6d7688e38c tempest-AttachVolumeTestJSON-1693410156 None] Terminate volume connection completed successfully. Sep 23 15:15:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-8baaafd4-ec3c-4fb9-ae9c-b7e924fae411 req-22b0786a-7a25-46a8-9586-db6d7688e38c tempest-AttachVolumeTestJSON-1693410156 None] Deleting attachment ee0ec26c-42bd-4065-b291-ff963a93c74e. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:15:57 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_wir8pt6vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665" returned: 0 in 2.819s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:57 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_wir8pt6vdevstack@QuobyteHD, size 112.00 MB, duration 2.82 sec, destination /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665 {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:15:57 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Converted 112.00 MB image at 39.70 MB/s Sep 23 15:15:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:15:57 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665 1G Sep 23 15:15:57 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:15:57 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Sep 23 15:15:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665 1G" returned: 0 in 0.427s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:15:57 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Downloaded image e612db8e-4d33-469a-9b98-e7920f09b036 ((None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}])) to volume b35ad1ca-e419-4a5b-a1b2-7fc88de73665 successfully. {{(pid=86064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 15:15:57 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Temporary image e612db8e-4d33-469a-9b98-e7920f09b036 for user d43ba224e8a14850998f0b889ca1a39d is deleted. {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 15:15:57 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Marking volume b35ad1ca-e419-4a5b-a1b2-7fc88de73665 as bootable. {{(pid=86064) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 15:15:57 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Copying metadata from image e612db8e-4d33-469a-9b98-e7920f09b036 to b35ad1ca-e419-4a5b-a1b2-7fc88de73665. {{(pid=86064) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 15:15:57 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Creating volume glance metadata for volume b35ad1ca-e419-4a5b-a1b2-7fc88de73665 backed by image e612db8e-4d33-469a-9b98-e7920f09b036 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86064) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 15:15:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead8d2b8-043f-45c4-b735-9f9acec12952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665', 'volume_size': 1, 'image_id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6096e44b8882450f8963b9e995032e95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'created_at': datetime.datetime(2026, 9, 23, 13, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e612db8e-4d33-469a-9b98-e7920f09b036/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c69d098-9d30-40bc-a6eb-e39f5ae116b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:15:57 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Volume volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665 (b35ad1ca-e419-4a5b-a1b2-7fc88de73665): created successfully Sep 23 15:15:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c69d098-9d30-40bc-a6eb-e39f5ae116b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:15:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Flow 'volume_create_manager' (eafde818-541a-4acd-a40f-95dade2c730e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:15:57 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-0f468eb7-5e76-407b-ada0-70a9248d6a53 tempest-VolumesImageMetadata-514733594 None] Created volume successfully. Sep 23 15:15:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-372960bf-eeb5-499f-a162-8174adfa1263 tempest-VolumesImageMetadata-514733594 None] Acquiring lock "cinder-b35ad1ca-e419-4a5b-a1b2-7fc88de73665-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:15:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-372960bf-eeb5-499f-a162-8174adfa1263 tempest-VolumesImageMetadata-514733594 None] Lock "cinder-b35ad1ca-e419-4a5b-a1b2-7fc88de73665-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:00 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-372960bf-eeb5-499f-a162-8174adfa1263 tempest-VolumesImageMetadata-514733594 None] Acquiring lock "cinder-quobyte-b35ad1ca-e419-4a5b-a1b2-7fc88de73665" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:00 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-372960bf-eeb5-499f-a162-8174adfa1263 tempest-VolumesImageMetadata-514733594 None] Lock "cinder-quobyte-b35ad1ca-e419-4a5b-a1b2-7fc88de73665" acquired by "delete_volume" :: waited 0.048s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:00 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06fa3d8-d29e-4d1d-ae2d-d1a5818bce95]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-372960bf-eeb5-499f-a162-8174adfa1263 tempest-VolumesImageMetadata-514733594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:00 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665 Sep 23 15:16:00 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:00 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-372960bf-eeb5-499f-a162-8174adfa1263 tempest-VolumesImageMetadata-514733594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665" returned: 0 in 0.532s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-372960bf-eeb5-499f-a162-8174adfa1263 tempest-VolumesImageMetadata-514733594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:00 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665 Sep 23 15:16:00 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:00 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-372960bf-eeb5-499f-a162-8174adfa1263 tempest-VolumesImageMetadata-514733594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b35ad1ca-e419-4a5b-a1b2-7fc88de73665" returned: 0 in 0.298s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:00 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-372960bf-eeb5-499f-a162-8174adfa1263 tempest-VolumesImageMetadata-514733594 None] Lock "cinder-quobyte-b35ad1ca-e419-4a5b-a1b2-7fc88de73665" released by "delete_volume" :: held 0.922s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:01 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-372960bf-eeb5-499f-a162-8174adfa1263 tempest-VolumesImageMetadata-514733594 None] Created reservations ['8e4e3509-7dad-4b65-bb00-539173e31de1', '90ccb5b4-bfc0-45b8-bf5f-fd3b656ae250', 'b349287d-2944-4e0c-a889-7831d26029a1', '963d545a-ba94-46e3-b5ca-7bb972408904'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:16:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-372960bf-eeb5-499f-a162-8174adfa1263 tempest-VolumesImageMetadata-514733594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-372960bf-eeb5-499f-a162-8174adfa1263 tempest-VolumesImageMetadata-514733594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-372960bf-eeb5-499f-a162-8174adfa1263 tempest-VolumesImageMetadata-514733594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-372960bf-eeb5-499f-a162-8174adfa1263 tempest-VolumesImageMetadata-514733594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-372960bf-eeb5-499f-a162-8174adfa1263 tempest-VolumesImageMetadata-514733594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-372960bf-eeb5-499f-a162-8174adfa1263 tempest-VolumesImageMetadata-514733594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:01 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:16:01 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:01 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-372960bf-eeb5-499f-a162-8174adfa1263 tempest-VolumesImageMetadata-514733594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.292s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:01 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-372960bf-eeb5-499f-a162-8174adfa1263 tempest-VolumesImageMetadata-514733594 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:16:01 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-372960bf-eeb5-499f-a162-8174adfa1263 tempest-VolumesImageMetadata-514733594 None] Deleted volume successfully. Sep 23 15:16:01 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-372960bf-eeb5-499f-a162-8174adfa1263 tempest-VolumesImageMetadata-514733594 None] Lock "cinder-b35ad1ca-e419-4a5b-a1b2-7fc88de73665-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:02 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-995849db-59bb-49bc-a423-8e73b0cb8776 tempest-AttachVolumeTestJSON-1693410156 None] Acquiring lock "cinder-a9839ec0-4c5b-457c-8264-b958f849923a-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:02 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-995849db-59bb-49bc-a423-8e73b0cb8776 tempest-AttachVolumeTestJSON-1693410156 None] Lock "cinder-a9839ec0-4c5b-457c-8264-b958f849923a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:02 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=97,cinder:UPDATE=121,cinder:DELETE=7,cinder:INSERT=39 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:16:02 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=106,cinder:UPDATE=101,cinder:INSERT=28,cinder:DELETE=14 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:16:02 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-995849db-59bb-49bc-a423-8e73b0cb8776 tempest-AttachVolumeTestJSON-1693410156 None] Acquiring lock "cinder-quobyte-a9839ec0-4c5b-457c-8264-b958f849923a" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:02 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-995849db-59bb-49bc-a423-8e73b0cb8776 tempest-AttachVolumeTestJSON-1693410156 None] Lock "cinder-quobyte-a9839ec0-4c5b-457c-8264-b958f849923a" acquired by "delete_volume" :: waited 0.027s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:02 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e868cff6-69c5-4b07-ae17-9f431e4cefde]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-995849db-59bb-49bc-a423-8e73b0cb8776 tempest-AttachVolumeTestJSON-1693410156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a9839ec0-4c5b-457c-8264-b958f849923a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:02 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a9839ec0-4c5b-457c-8264-b958f849923a Sep 23 15:16:02 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:03 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-995849db-59bb-49bc-a423-8e73b0cb8776 tempest-AttachVolumeTestJSON-1693410156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a9839ec0-4c5b-457c-8264-b958f849923a" returned: 0 in 0.447s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-995849db-59bb-49bc-a423-8e73b0cb8776 tempest-AttachVolumeTestJSON-1693410156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a9839ec0-4c5b-457c-8264-b958f849923a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:03 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a9839ec0-4c5b-457c-8264-b958f849923a Sep 23 15:16:03 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:03 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-995849db-59bb-49bc-a423-8e73b0cb8776 tempest-AttachVolumeTestJSON-1693410156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a9839ec0-4c5b-457c-8264-b958f849923a" returned: 0 in 0.325s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:03 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-995849db-59bb-49bc-a423-8e73b0cb8776 tempest-AttachVolumeTestJSON-1693410156 None] Lock "cinder-quobyte-a9839ec0-4c5b-457c-8264-b958f849923a" released by "delete_volume" :: held 0.832s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:03 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-995849db-59bb-49bc-a423-8e73b0cb8776 tempest-AttachVolumeTestJSON-1693410156 None] Created reservations ['48549881-c83a-47a8-8430-f7dbaac34555', '0b9dc8ad-790d-4105-8b97-9f0e875637db', '2f3660e3-deb9-4454-8422-effb8e394f84', 'cc57e863-e237-4dd7-99d5-4f527f2cf0a5'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:16:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-995849db-59bb-49bc-a423-8e73b0cb8776 tempest-AttachVolumeTestJSON-1693410156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-995849db-59bb-49bc-a423-8e73b0cb8776 tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:03 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-995849db-59bb-49bc-a423-8e73b0cb8776 tempest-AttachVolumeTestJSON-1693410156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:03 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-995849db-59bb-49bc-a423-8e73b0cb8776 tempest-AttachVolumeTestJSON-1693410156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-995849db-59bb-49bc-a423-8e73b0cb8776 tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-995849db-59bb-49bc-a423-8e73b0cb8776 tempest-AttachVolumeTestJSON-1693410156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:03 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:16:03 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e55641bd-ae54-4a58-990d-0ff2a97d7385 tempest-AttachVolumeTestJSON-1693410156 None] Acquiring lock "cinder-55ea9fde-b082-460e-8c74-cf0390a45c3b-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e55641bd-ae54-4a58-990d-0ff2a97d7385 tempest-AttachVolumeTestJSON-1693410156 None] Lock "cinder-55ea9fde-b082-460e-8c74-cf0390a45c3b-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Flow 'volume_create_manager' (cd491825-0c09-4017-bde2-3470db81fc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e9f680-cb85-487a-ab97-c24a9bcaeedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:04 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e9f680-cb85-487a-ab97-c24a9bcaeedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-166116116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5befd52-4f7d-4250-8f95-da30b0d072ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d536c8ab8624b42b66fa565bf4433f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:16:04Z,use_quota=True,user_id='46eb8608758e4ed5863503f914593150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be2377eb-542e-4113-9eb8-39c806167c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be2377eb-542e-4113-9eb8-39c806167c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0bd9871-34ef-4684-96eb-142d6c522d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0bd9871-34ef-4684-96eb-142d6c522d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5befd52-4f7d-4250-8f95-da30b0d072ad', 'volume_name': 'volume-d5befd52-4f7d-4250-8f95-da30b0d072ad', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797982f3-6522-44f4-8d71-fcababe0639b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797982f3-6522-44f4-8d71-fcababe0639b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da24c962-011a-46bd-a5a5-f7feb8294b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:04 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Volume d5befd52-4f7d-4250-8f95-da30b0d072ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5befd52-4f7d-4250-8f95-da30b0d072ad', 'volume_size': 1} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-166116116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5befd52-4f7d-4250-8f95-da30b0d072ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d536c8ab8624b42b66fa565bf4433f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:16:04Z,use_quota=True,user_id='46eb8608758e4ed5863503f914593150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Creating volume d5befd52-4f7d-4250-8f95-da30b0d072ad {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:16:04 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-995849db-59bb-49bc-a423-8e73b0cb8776 tempest-AttachVolumeTestJSON-1693410156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.408s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-995849db-59bb-49bc-a423-8e73b0cb8776 tempest-AttachVolumeTestJSON-1693410156 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:16:04 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad 1073741824 Sep 23 15:16:04 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:04 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-995849db-59bb-49bc-a423-8e73b0cb8776 tempest-AttachVolumeTestJSON-1693410156 None] Deleted volume successfully. Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e55641bd-ae54-4a58-990d-0ff2a97d7385 tempest-AttachVolumeTestJSON-1693410156 None] Acquiring lock "cinder-quobyte-55ea9fde-b082-460e-8c74-cf0390a45c3b" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e55641bd-ae54-4a58-990d-0ff2a97d7385 tempest-AttachVolumeTestJSON-1693410156 None] Lock "cinder-quobyte-55ea9fde-b082-460e-8c74-cf0390a45c3b" acquired by "delete_volume" :: waited 0.021s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-995849db-59bb-49bc-a423-8e73b0cb8776 tempest-AttachVolumeTestJSON-1693410156 None] Lock "cinder-a9839ec0-4c5b-457c-8264-b958f849923a-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5991e9a-f667-410a-9f88-14b0f53bc350]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e55641bd-ae54-4a58-990d-0ff2a97d7385 tempest-AttachVolumeTestJSON-1693410156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-55ea9fde-b082-460e-8c74-cf0390a45c3b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:04 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-55ea9fde-b082-460e-8c74-cf0390a45c3b Sep 23 15:16:04 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:04 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e55641bd-ae54-4a58-990d-0ff2a97d7385 tempest-AttachVolumeTestJSON-1693410156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-55ea9fde-b082-460e-8c74-cf0390a45c3b" returned: 0 in 0.426s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:04 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e55641bd-ae54-4a58-990d-0ff2a97d7385 tempest-AttachVolumeTestJSON-1693410156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-55ea9fde-b082-460e-8c74-cf0390a45c3b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad 1073741824" returned: 0 in 0.534s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:04 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-55ea9fde-b082-460e-8c74-cf0390a45c3b Sep 23 15:16:04 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:04 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad Sep 23 15:16:04 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:05 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e55641bd-ae54-4a58-990d-0ff2a97d7385 tempest-AttachVolumeTestJSON-1693410156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-55ea9fde-b082-460e-8c74-cf0390a45c3b" returned: 0 in 0.291s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:05 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e55641bd-ae54-4a58-990d-0ff2a97d7385 tempest-AttachVolumeTestJSON-1693410156 None] Lock "cinder-quobyte-55ea9fde-b082-460e-8c74-cf0390a45c3b" released by "delete_volume" :: held 0.771s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:05 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad" returned: 0 in 0.284s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:16:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da24c962-011a-46bd-a5a5-f7feb8294b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5befd52-4f7d-4250-8f95-da30b0d072ad', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a9fd8c-105e-40b2-9ee8-9f3c58505128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:05 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Volume volume-d5befd52-4f7d-4250-8f95-da30b0d072ad (d5befd52-4f7d-4250-8f95-da30b0d072ad): created successfully Sep 23 15:16:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a9fd8c-105e-40b2-9ee8-9f3c58505128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Flow 'volume_create_manager' (cd491825-0c09-4017-bde2-3470db81fc5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:16:05 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-67657478-b9fb-4d49-877f-2d28325e2eff tempest-VolumesCloneTest-1755740488 None] Created volume successfully. Sep 23 15:16:05 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-e55641bd-ae54-4a58-990d-0ff2a97d7385 tempest-AttachVolumeTestJSON-1693410156 None] Created reservations ['a279f567-8aa6-46ec-a455-8da2d0a93fff', 'f25a8026-5813-4f07-a824-8a75d26d7a6b', 'f39d549c-0838-4a35-b049-fbf8ed87afc8', '54486cb5-b68a-4267-b342-2f6c315e30ab'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:16:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e55641bd-ae54-4a58-990d-0ff2a97d7385 tempest-AttachVolumeTestJSON-1693410156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e55641bd-ae54-4a58-990d-0ff2a97d7385 tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e55641bd-ae54-4a58-990d-0ff2a97d7385 tempest-AttachVolumeTestJSON-1693410156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e55641bd-ae54-4a58-990d-0ff2a97d7385 tempest-AttachVolumeTestJSON-1693410156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e55641bd-ae54-4a58-990d-0ff2a97d7385 tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e55641bd-ae54-4a58-990d-0ff2a97d7385 tempest-AttachVolumeTestJSON-1693410156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:05 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:16:05 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:05 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e55641bd-ae54-4a58-990d-0ff2a97d7385 tempest-AttachVolumeTestJSON-1693410156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.243s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:05 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-e55641bd-ae54-4a58-990d-0ff2a97d7385 tempest-AttachVolumeTestJSON-1693410156 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:16:05 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-e55641bd-ae54-4a58-990d-0ff2a97d7385 tempest-AttachVolumeTestJSON-1693410156 None] Deleted volume successfully. Sep 23 15:16:05 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e55641bd-ae54-4a58-990d-0ff2a97d7385 tempest-AttachVolumeTestJSON-1693410156 None] Lock "cinder-55ea9fde-b082-460e-8c74-cf0390a45c3b-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ecd2fbbd-32b6-4d7a-b4e0-c3c60a2898a2 tempest-AttachVolumeTestJSON-1693410156 None] Acquiring lock "cinder-58d80cfc-2444-498a-b956-bdf8bdffaa4e-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ecd2fbbd-32b6-4d7a-b4e0-c3c60a2898a2 tempest-AttachVolumeTestJSON-1693410156 None] Lock "cinder-58d80cfc-2444-498a-b956-bdf8bdffaa4e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ecd2fbbd-32b6-4d7a-b4e0-c3c60a2898a2 tempest-AttachVolumeTestJSON-1693410156 None] Acquiring lock "cinder-quobyte-58d80cfc-2444-498a-b956-bdf8bdffaa4e" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ecd2fbbd-32b6-4d7a-b4e0-c3c60a2898a2 tempest-AttachVolumeTestJSON-1693410156 None] Lock "cinder-quobyte-58d80cfc-2444-498a-b956-bdf8bdffaa4e" acquired by "delete_volume" :: waited 0.031s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:06 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:16:06 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fad9439-a076-4043-b200-5438fc5d6e72]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ecd2fbbd-32b6-4d7a-b4e0-c3c60a2898a2 tempest-AttachVolumeTestJSON-1693410156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-58d80cfc-2444-498a-b956-bdf8bdffaa4e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Flow 'volume_create_manager' (ea8c85d6-90b1-44df-a923-c293d434e1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:16:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079dbbc3-73ac-4d83-add7-6b47d1a47b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079dbbc3-73ac-4d83-add7-6b47d1a47b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-390770577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e573039-46ab-41be-95d4-a230b033df4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d536c8ab8624b42b66fa565bf4433f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:16:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=d5befd52-4f7d-4250-8f95-da30b0d072ad,status='creating',terminated_at=None,updated_at=2026-09-23T13:16:07Z,use_quota=True,user_id='46eb8608758e4ed5863503f914593150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bfc036e-08a7-4abe-836a-2a5ec116c876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bfc036e-08a7-4abe-836a-2a5ec116c876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a9e8381-b700-478b-95d5-67f62b20dfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:06 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-58d80cfc-2444-498a-b956-bdf8bdffaa4e Sep 23 15:16:06 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a9e8381-b700-478b-95d5-67f62b20dfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4e573039-46ab-41be-95d4-a230b033df4a', 'volume_name': 'volume-4e573039-46ab-41be-95d4-a230b033df4a', 'volume_size': 2, 'source_volid': 'd5befd52-4f7d-4250-8f95-da30b0d072ad', 'source_volstatus': 'available'}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4938da-1185-4337-8929-266535c3ba97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4938da-1185-4337-8929-266535c3ba97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b56cee-223d-4ab5-81f1-7e8f59cf9225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:06 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Volume 4e573039-46ab-41be-95d4-a230b033df4a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4e573039-46ab-41be-95d4-a230b033df4a', 'volume_size': 2, 'source_volid': 'd5befd52-4f7d-4250-8f95-da30b0d072ad', 'source_volstatus': 'available'} Sep 23 15:16:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:06 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Cloning volume d5befd52-4f7d-4250-8f95-da30b0d072ad to volume 4e573039-46ab-41be-95d4-a230b033df4a Sep 23 15:16:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Creating offline snapshot 2e4fb3c5-503e-450c-a928-e546a75f63d3 of volume d5befd52-4f7d-4250-8f95-da30b0d072ad {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:16:06 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[85affb7e-09c7-4a61-a94f-d748bcbbc69a]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:07 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:07 devstack sudo[97478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad Sep 23 15:16:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ecd2fbbd-32b6-4d7a-b4e0-c3c60a2898a2 tempest-AttachVolumeTestJSON-1693410156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-58d80cfc-2444-498a-b956-bdf8bdffaa4e" returned: 0 in 0.476s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:07 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ecd2fbbd-32b6-4d7a-b4e0-c3c60a2898a2 tempest-AttachVolumeTestJSON-1693410156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-58d80cfc-2444-498a-b956-bdf8bdffaa4e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:07 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-58d80cfc-2444-498a-b956-bdf8bdffaa4e Sep 23 15:16:07 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:07 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad" returned: 0 in 0.553s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:07 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ecd2fbbd-32b6-4d7a-b4e0-c3c60a2898a2 tempest-AttachVolumeTestJSON-1693410156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-58d80cfc-2444-498a-b956-bdf8bdffaa4e" returned: 0 in 0.366s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:07 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ecd2fbbd-32b6-4d7a-b4e0-c3c60a2898a2 tempest-AttachVolumeTestJSON-1693410156 None] Lock "cinder-quobyte-58d80cfc-2444-498a-b956-bdf8bdffaa4e" released by "delete_volume" :: held 0.925s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:07 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3 1G Sep 23 15:16:07 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:07 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-ecd2fbbd-32b6-4d7a-b4e0-c3c60a2898a2 tempest-AttachVolumeTestJSON-1693410156 None] Created reservations ['07d43013-5a93-472d-bd82-f0d42adef460', '1723ab37-1c6f-40e7-ba83-de514eaaa60d', 'b0374208-9f0c-4129-ae26-05edef6e51bc', 'fcf215db-2847-46fd-b396-ac100137cec5'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:16:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ecd2fbbd-32b6-4d7a-b4e0-c3c60a2898a2 tempest-AttachVolumeTestJSON-1693410156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ecd2fbbd-32b6-4d7a-b4e0-c3c60a2898a2 tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ecd2fbbd-32b6-4d7a-b4e0-c3c60a2898a2 tempest-AttachVolumeTestJSON-1693410156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ecd2fbbd-32b6-4d7a-b4e0-c3c60a2898a2 tempest-AttachVolumeTestJSON-1693410156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ecd2fbbd-32b6-4d7a-b4e0-c3c60a2898a2 tempest-AttachVolumeTestJSON-1693410156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ecd2fbbd-32b6-4d7a-b4e0-c3c60a2898a2 tempest-AttachVolumeTestJSON-1693410156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:07 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:16:07 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:07 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:16:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Flow 'volume_create_manager' (05b9d7eb-90c4-412d-8d2d-8beaf3e95a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:16:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4edc824-d247-40b8-99ac-3ab62ae7f1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4edc824-d247-40b8-99ac-3ab62ae7f1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1631004799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b87d1033-c122-4e2b-8fac-d1871f3c9b65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3598faa6bd31406d8d04377c1c7b7ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:16:08Z,use_quota=True,user_id='370cba3fffe84ba0b3308eed1ef0ad5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b15c987-0eba-4dae-93ec-02bbbf7b9d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b15c987-0eba-4dae-93ec-02bbbf7b9d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69fd4a24-19e1-441a-a52c-4fb38dfcba72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69fd4a24-19e1-441a-a52c-4fb38dfcba72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b87d1033-c122-4e2b-8fac-d1871f3c9b65', 'volume_name': 'volume-b87d1033-c122-4e2b-8fac-d1871f3c9b65', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5ed25e-a5ca-442e-96b6-10f4c9133ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5ed25e-a5ca-442e-96b6-10f4c9133ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9233ef44-105a-4ef0-a703-c1c3aa278f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:08 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Volume b87d1033-c122-4e2b-8fac-d1871f3c9b65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b87d1033-c122-4e2b-8fac-d1871f3c9b65', 'volume_size': 1} Sep 23 15:16:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:08 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:08 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3 1G" returned: 0 in 0.617s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5befd52-4f7d-4250-8f95-da30b0d072ad -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ecd2fbbd-32b6-4d7a-b4e0-c3c60a2898a2 tempest-AttachVolumeTestJSON-1693410156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.341s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:08 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-ecd2fbbd-32b6-4d7a-b4e0-c3c60a2898a2 tempest-AttachVolumeTestJSON-1693410156 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:16:08 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-ecd2fbbd-32b6-4d7a-b4e0-c3c60a2898a2 tempest-AttachVolumeTestJSON-1693410156 None] Deleted volume successfully. Sep 23 15:16:08 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5befd52-4f7d-4250-8f95-da30b0d072ad -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3 Sep 23 15:16:08 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:08 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ecd2fbbd-32b6-4d7a-b4e0-c3c60a2898a2 tempest-AttachVolumeTestJSON-1693410156 None] Lock "cinder-58d80cfc-2444-498a-b956-bdf8bdffaa4e-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:08 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5befd52-4f7d-4250-8f95-da30b0d072ad -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3" returned: 0 in 0.340s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:08 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3 is being set with open permissions: ugo+rw Sep 23 15:16:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:08 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3 Sep 23 15:16:08 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:08 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3" returned: 0 in 0.240s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:08 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.info Sep 23 15:16:08 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:09 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.info" returned: 0 in 0.329s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:09 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.info is being set with open permissions: ugo+rw Sep 23 15:16:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:09 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.info Sep 23 15:16:09 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:09 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.info" returned: 0 in 0.322s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:09 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Acquiring lock "cinder-quobyte-4e573039-46ab-41be-95d4-a230b033df4a" by "_copy_volume_from_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:09 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Lock "cinder-quobyte-4e573039-46ab-41be-95d4-a230b033df4a" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:09 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] snapshot: 2e4fb3c5-503e-450c-a928-e546a75f63d3, volume: 4e573039-46ab-41be-95d4-a230b033df4a, {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 15:16:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:09 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:09 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:09 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[253b809a-0aef-4731-b874-bb0f3ff2971f]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:09 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3 Sep 23 15:16:09 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:09 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3" returned: 0 in 0.465s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:09 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5befd52-4f7d-4250-8f95-da30b0d072ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:16:09 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a363caca-3d5c-4f46-8964-9aa373128731]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:10 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad Sep 23 15:16:10 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:10 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad" returned: 0 in 0.376s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 15:16:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Creating direct copy from snapshot {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 15:16:10 devstack cinder-volume[86064]: DEBUG cinder.utils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Path /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e573039-46ab-41be-95d4-a230b033df4a not found in is_blk_device check {{(pid=86064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 15:16:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e573039-46ab-41be-95d4-a230b033df4a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:10 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e573039-46ab-41be-95d4-a230b033df4a Sep 23 15:16:10 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-c962fefe-b994-4b57-8253-92c1cb06937f req-dde9f555-3aae-4e63-b0b1-af7b570c8592 tempest-TestInstancesWithCinderVolumes-255478537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:18 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e573039-46ab-41be-95d4-a230b033df4a" returned: 0 in 8.149s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:18 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad, size 1024.00 MB, duration 8.15 sec, destination /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e573039-46ab-41be-95d4-a230b033df4a {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:16:18 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Converted 1024.00 MB image at 125.64 MB/s Sep 23 15:16:18 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e573039-46ab-41be-95d4-a230b033df4a is being set with open permissions: ugo+rw Sep 23 15:16:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e573039-46ab-41be-95d4-a230b033df4a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:18 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e573039-46ab-41be-95d4-a230b033df4a Sep 23 15:16:18 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:18 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e573039-46ab-41be-95d4-a230b033df4a" returned: 0 in 0.258s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Lock "cinder-quobyte-4e573039-46ab-41be-95d4-a230b033df4a" released by "_copy_volume_from_snapshot" :: held 9.347s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Acquiring lock "cinder-quobyte-2e4fb3c5-503e-450c-a928-e546a75f63d3" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Lock "cinder-quobyte-2e4fb3c5-503e-450c-a928-e546a75f63d3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Deleting offline snapshot 2e4fb3c5-503e-450c-a928-e546a75f63d3 of volume d5befd52-4f7d-4250-8f95-da30b0d072ad {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:16:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] snapshot_file for this snap is: volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:16:18 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84c84b5-5716-4654-91e8-4c83eb7c2e53]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:18 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3 Sep 23 15:16:18 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:19 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3" returned: 0 in 0.379s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5befd52-4f7d-4250-8f95-da30b0d072ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:16:19 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acc9202-faf2-43d8-a66d-0a116771ea3e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:19 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad Sep 23 15:16:19 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:19 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad" returned: 0 in 0.553s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:19 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3 Sep 23 15:16:19 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:20 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3" returned: 0 in 0.426s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:20 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3 Sep 23 15:16:20 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Flow 'volume_create_manager' (e5708bb6-998e-4e54-883e-0f166b922f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (876bf045-6171-4c16-9c38-f93164d526ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (876bf045-6171-4c16-9c38-f93164d526ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2056126169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf4409a8-5ea9-4f21-b50e-22398dfd5e3f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='46db6db2d3fd4be8a942889ac252b5c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:16:20Z,use_quota=True,user_id='ceeaf7b970e744a8942ee3172f217f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f276a9-962d-4953-b7ce-00cf9427575c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f276a9-962d-4953-b7ce-00cf9427575c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e86510-5828-41a4-8503-8fa6f3835789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e86510-5828-41a4-8503-8fa6f3835789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf4409a8-5ea9-4f21-b50e-22398dfd5e3f', 'volume_name': 'volume-bf4409a8-5ea9-4f21-b50e-22398dfd5e3f', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80421fdb-e207-4418-bfc4-1d8abcc0fd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80421fdb-e207-4418-bfc4-1d8abcc0fd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa011d3c-5d22-49b0-9826-5e711df448cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:20 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Volume bf4409a8-5ea9-4f21-b50e-22398dfd5e3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf4409a8-5ea9-4f21-b50e-22398dfd5e3f', 'volume_size': 1} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:20 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad.2e4fb3c5-503e-450c-a928-e546a75f63d3" returned: 0 in 0.277s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Lock "cinder-quobyte-2e4fb3c5-503e-450c-a928-e546a75f63d3" released by "_delete_snapshot" :: held 1.756s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.737s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.573s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1631004799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b87d1033-c122-4e2b-8fac-d1871f3c9b65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3598faa6bd31406d8d04377c1c7b7ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:16:08Z,use_quota=True,user_id='370cba3fffe84ba0b3308eed1ef0ad5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Creating volume b87d1033-c122-4e2b-8fac-d1871f3c9b65 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:16:20 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b87d1033-c122-4e2b-8fac-d1871f3c9b65 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:20 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b87d1033-c122-4e2b-8fac-d1871f3c9b65 1073741824 Sep 23 15:16:20 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b56cee-223d-4ab5-81f1-7e8f59cf9225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e573039-46ab-41be-95d4-a230b033df4a', 'volume_size': 2, 'source_volid': 'd5befd52-4f7d-4250-8f95-da30b0d072ad', 'source_volstatus': 'available'}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7ff835-92fb-4cac-a8ba-bd57faa1b48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:20 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Volume volume-4e573039-46ab-41be-95d4-a230b033df4a (4e573039-46ab-41be-95d4-a230b033df4a): created successfully Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7ff835-92fb-4cac-a8ba-bd57faa1b48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Flow 'volume_create_manager' (ea8c85d6-90b1-44df-a923-c293d434e1c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:16:20 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f24463fe-466f-4f40-b214-cba5d452872e tempest-VolumesCloneTest-1755740488 None] Created volume successfully. Sep 23 15:16:21 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b87d1033-c122-4e2b-8fac-d1871f3c9b65 1073741824" returned: 0 in 0.428s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b87d1033-c122-4e2b-8fac-d1871f3c9b65 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:21 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b87d1033-c122-4e2b-8fac-d1871f3c9b65 Sep 23 15:16:21 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:21 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b87d1033-c122-4e2b-8fac-d1871f3c9b65" returned: 0 in 0.272s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-c962fefe-b994-4b57-8253-92c1cb06937f req-dde9f555-3aae-4e63-b0b1-af7b570c8592 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.294s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9233ef44-105a-4ef0-a703-c1c3aa278f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b87d1033-c122-4e2b-8fac-d1871f3c9b65', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3644eb95-b875-4047-b581-c352d674469c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-c962fefe-b994-4b57-8253-92c1cb06937f req-dde9f555-3aae-4e63-b0b1-af7b570c8592 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.923s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2056126169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf4409a8-5ea9-4f21-b50e-22398dfd5e3f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='46db6db2d3fd4be8a942889ac252b5c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:16:20Z,use_quota=True,user_id='ceeaf7b970e744a8942ee3172f217f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Creating volume bf4409a8-5ea9-4f21-b50e-22398dfd5e3f {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:16:21 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bf4409a8-5ea9-4f21-b50e-22398dfd5e3f 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:21 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Volume volume-b87d1033-c122-4e2b-8fac-d1871f3c9b65 (b87d1033-c122-4e2b-8fac-d1871f3c9b65): created successfully Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3644eb95-b875-4047-b581-c352d674469c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:21 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bf4409a8-5ea9-4f21-b50e-22398dfd5e3f 1073741824 Sep 23 15:16:21 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Flow 'volume_create_manager' (05b9d7eb-90c4-412d-8d2d-8beaf3e95a8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:16:21 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-3d3fdc58-9c1b-4ad3-b4a0-026f2248a8f6 tempest-AbsoluteLimitsTests-1717923510 None] Created volume successfully. Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-c962fefe-b994-4b57-8253-92c1cb06937f req-dde9f555-3aae-4e63-b0b1-af7b570c8592 tempest-TestInstancesWithCinderVolumes-255478537 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-97044aa9-cbee-423d-948c-0fe106c68972', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48b3d414-fac3-41d1-941f-862479b633df', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:16:21 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-c962fefe-b994-4b57-8253-92c1cb06937f req-dde9f555-3aae-4e63-b0b1-af7b570c8592 tempest-TestInstancesWithCinderVolumes-255478537 None] attachment_update completed successfully. Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-48ab2534-c8ae-44dd-8d21-19e0be49ab3a tempest-VolumesCloneTest-1755740488 None] Acquiring lock "cinder-4e573039-46ab-41be-95d4-a230b033df4a-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-48ab2534-c8ae-44dd-8d21-19e0be49ab3a tempest-VolumesCloneTest-1755740488 None] Lock "cinder-4e573039-46ab-41be-95d4-a230b033df4a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-48ab2534-c8ae-44dd-8d21-19e0be49ab3a tempest-VolumesCloneTest-1755740488 None] Acquiring lock "cinder-quobyte-4e573039-46ab-41be-95d4-a230b033df4a" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-48ab2534-c8ae-44dd-8d21-19e0be49ab3a tempest-VolumesCloneTest-1755740488 None] Lock "cinder-quobyte-4e573039-46ab-41be-95d4-a230b033df4a" acquired by "delete_volume" :: waited 0.029s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87c2c75-1b4e-432e-b68f-6ddc321365b2]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-48ab2534-c8ae-44dd-8d21-19e0be49ab3a tempest-VolumesCloneTest-1755740488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e573039-46ab-41be-95d4-a230b033df4a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:22 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bf4409a8-5ea9-4f21-b50e-22398dfd5e3f 1073741824" returned: 0 in 0.594s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bf4409a8-5ea9-4f21-b50e-22398dfd5e3f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:22 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e573039-46ab-41be-95d4-a230b033df4a Sep 23 15:16:22 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:22 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bf4409a8-5ea9-4f21-b50e-22398dfd5e3f Sep 23 15:16:22 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:22 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-48ab2534-c8ae-44dd-8d21-19e0be49ab3a tempest-VolumesCloneTest-1755740488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e573039-46ab-41be-95d4-a230b033df4a" returned: 0 in 0.423s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-48ab2534-c8ae-44dd-8d21-19e0be49ab3a tempest-VolumesCloneTest-1755740488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e573039-46ab-41be-95d4-a230b033df4a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:22 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bf4409a8-5ea9-4f21-b50e-22398dfd5e3f" returned: 0 in 0.313s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:22 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e573039-46ab-41be-95d4-a230b033df4a Sep 23 15:16:22 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa011d3c-5d22-49b0-9826-5e711df448cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf4409a8-5ea9-4f21-b50e-22398dfd5e3f', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dbb0b6e-de6d-4e48-a924-99a1e4e7162c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:22 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Volume volume-bf4409a8-5ea9-4f21-b50e-22398dfd5e3f (bf4409a8-5ea9-4f21-b50e-22398dfd5e3f): created successfully Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dbb0b6e-de6d-4e48-a924-99a1e4e7162c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Flow 'volume_create_manager' (e5708bb6-998e-4e54-883e-0f166b922f68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:16:22 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-6bdafc00-412f-472f-a4b0-cfad259c46c2 tempest-VolumesTestJSON-212647168 None] Created volume successfully. Sep 23 15:16:22 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-48ab2534-c8ae-44dd-8d21-19e0be49ab3a tempest-VolumesCloneTest-1755740488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4e573039-46ab-41be-95d4-a230b033df4a" returned: 0 in 0.272s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-48ab2534-c8ae-44dd-8d21-19e0be49ab3a tempest-VolumesCloneTest-1755740488 None] Lock "cinder-quobyte-4e573039-46ab-41be-95d4-a230b033df4a" released by "delete_volume" :: held 0.749s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-48ab2534-c8ae-44dd-8d21-19e0be49ab3a tempest-VolumesCloneTest-1755740488 None] Created reservations ['7ef631f5-3ecf-4459-b2bc-93ff4d2afbaf', 'cf274469-38ad-4a20-ae11-86b9e4cadcf6', '30926440-6731-4b48-90b8-d9f341b4d997', '12ece8e0-a7c4-47a4-a569-0dec23e9108a'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-48ab2534-c8ae-44dd-8d21-19e0be49ab3a tempest-VolumesCloneTest-1755740488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-48ab2534-c8ae-44dd-8d21-19e0be49ab3a tempest-VolumesCloneTest-1755740488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-48ab2534-c8ae-44dd-8d21-19e0be49ab3a tempest-VolumesCloneTest-1755740488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-48ab2534-c8ae-44dd-8d21-19e0be49ab3a tempest-VolumesCloneTest-1755740488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-48ab2534-c8ae-44dd-8d21-19e0be49ab3a tempest-VolumesCloneTest-1755740488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-48ab2534-c8ae-44dd-8d21-19e0be49ab3a tempest-VolumesCloneTest-1755740488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f0b17ac8-dad4-4bbd-819c-8742e482630d tempest-AbsoluteLimitsTests-1717923510 None] Acquiring lock "cinder-b87d1033-c122-4e2b-8fac-d1871f3c9b65-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:22 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:16:22 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f0b17ac8-dad4-4bbd-819c-8742e482630d tempest-AbsoluteLimitsTests-1717923510 None] Lock "cinder-b87d1033-c122-4e2b-8fac-d1871f3c9b65-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f0b17ac8-dad4-4bbd-819c-8742e482630d tempest-AbsoluteLimitsTests-1717923510 None] Acquiring lock "cinder-quobyte-b87d1033-c122-4e2b-8fac-d1871f3c9b65" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f0b17ac8-dad4-4bbd-819c-8742e482630d tempest-AbsoluteLimitsTests-1717923510 None] Lock "cinder-quobyte-b87d1033-c122-4e2b-8fac-d1871f3c9b65" acquired by "delete_volume" :: waited 0.026s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f715b001-71de-44fb-9ca6-0e64e3c52417]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f0b17ac8-dad4-4bbd-819c-8742e482630d tempest-AbsoluteLimitsTests-1717923510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b87d1033-c122-4e2b-8fac-d1871f3c9b65 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a8ac5332-a3ce-4520-8641-71af480030c0 tempest-VolumesCloneTest-1755740488 None] Acquiring lock "cinder-d5befd52-4f7d-4250-8f95-da30b0d072ad-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a8ac5332-a3ce-4520-8641-71af480030c0 tempest-VolumesCloneTest-1755740488 None] Lock "cinder-d5befd52-4f7d-4250-8f95-da30b0d072ad-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a8ac5332-a3ce-4520-8641-71af480030c0 tempest-VolumesCloneTest-1755740488 None] Acquiring lock "cinder-quobyte-d5befd52-4f7d-4250-8f95-da30b0d072ad" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:23 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b87d1033-c122-4e2b-8fac-d1871f3c9b65 Sep 23 15:16:23 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a8ac5332-a3ce-4520-8641-71af480030c0 tempest-VolumesCloneTest-1755740488 None] Lock "cinder-quobyte-d5befd52-4f7d-4250-8f95-da30b0d072ad" acquired by "delete_volume" :: waited 0.043s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:23 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-48ab2534-c8ae-44dd-8d21-19e0be49ab3a tempest-VolumesCloneTest-1755740488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.499s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-48ab2534-c8ae-44dd-8d21-19e0be49ab3a tempest-VolumesCloneTest-1755740488 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:16:23 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-48ab2534-c8ae-44dd-8d21-19e0be49ab3a tempest-VolumesCloneTest-1755740488 None] Deleted volume successfully. Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[33709124-f14b-491c-b6ad-891a58006f68]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a8ac5332-a3ce-4520-8641-71af480030c0 tempest-VolumesCloneTest-1755740488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-48ab2534-c8ae-44dd-8d21-19e0be49ab3a tempest-VolumesCloneTest-1755740488 None] Lock "cinder-4e573039-46ab-41be-95d4-a230b033df4a-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:23 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad Sep 23 15:16:23 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:23 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f0b17ac8-dad4-4bbd-819c-8742e482630d tempest-AbsoluteLimitsTests-1717923510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b87d1033-c122-4e2b-8fac-d1871f3c9b65" returned: 0 in 0.603s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f0b17ac8-dad4-4bbd-819c-8742e482630d tempest-AbsoluteLimitsTests-1717923510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b87d1033-c122-4e2b-8fac-d1871f3c9b65 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:23 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b87d1033-c122-4e2b-8fac-d1871f3c9b65 Sep 23 15:16:23 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Flow 'volume_create_manager' (7227fbe3-0c7b-4714-87d7-11e169336689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e12800e-18ef-4423-bd52-6a1293d061b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e12800e-18ef-4423-bd52-6a1293d061b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1128327008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e4335c-289d-4356-9fab-81f64711b94c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='46db6db2d3fd4be8a942889ac252b5c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:16:24Z,use_quota=True,user_id='ceeaf7b970e744a8942ee3172f217f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3a27d7-73c8-4237-927b-b7d27df8b60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3a27d7-73c8-4237-927b-b7d27df8b60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd91747-231c-4b93-ae6f-84d906a6d1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd91747-231c-4b93-ae6f-84d906a6d1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40e4335c-289d-4356-9fab-81f64711b94c', 'volume_name': 'volume-40e4335c-289d-4356-9fab-81f64711b94c', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f3eca1-fe66-4787-8c1d-9bfebb48ceff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f3eca1-fe66-4787-8c1d-9bfebb48ceff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a63ea5e-9f5b-4048-a5d6-81f2df0d2e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:23 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Volume 40e4335c-289d-4356-9fab-81f64711b94c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40e4335c-289d-4356-9fab-81f64711b94c', 'volume_size': 1} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1128327008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e4335c-289d-4356-9fab-81f64711b94c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='46db6db2d3fd4be8a942889ac252b5c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:16:24Z,use_quota=True,user_id='ceeaf7b970e744a8942ee3172f217f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Creating volume 40e4335c-289d-4356-9fab-81f64711b94c {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:16:23 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40e4335c-289d-4356-9fab-81f64711b94c 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:23 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a8ac5332-a3ce-4520-8641-71af480030c0 tempest-VolumesCloneTest-1755740488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad" returned: 0 in 0.626s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:23 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40e4335c-289d-4356-9fab-81f64711b94c 1073741824 Sep 23 15:16:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a8ac5332-a3ce-4520-8641-71af480030c0 tempest-VolumesCloneTest-1755740488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:23 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:24 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad Sep 23 15:16:24 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:24 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f0b17ac8-dad4-4bbd-819c-8742e482630d tempest-AbsoluteLimitsTests-1717923510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b87d1033-c122-4e2b-8fac-d1871f3c9b65" returned: 0 in 0.417s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f0b17ac8-dad4-4bbd-819c-8742e482630d tempest-AbsoluteLimitsTests-1717923510 None] Lock "cinder-quobyte-b87d1033-c122-4e2b-8fac-d1871f3c9b65" released by "delete_volume" :: held 1.116s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-f0b17ac8-dad4-4bbd-819c-8742e482630d tempest-AbsoluteLimitsTests-1717923510 None] Created reservations ['1ddde517-2c5e-4402-956a-81f2004a745a', '7f7b79a7-b4c8-424b-b9e5-4973fadb08cf', '596ca02c-bfbc-492c-8218-5de64b8819ae', '012c548a-9bcb-43af-bcec-45b4cb86f821'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f0b17ac8-dad4-4bbd-819c-8742e482630d tempest-AbsoluteLimitsTests-1717923510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f0b17ac8-dad4-4bbd-819c-8742e482630d tempest-AbsoluteLimitsTests-1717923510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f0b17ac8-dad4-4bbd-819c-8742e482630d tempest-AbsoluteLimitsTests-1717923510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f0b17ac8-dad4-4bbd-819c-8742e482630d tempest-AbsoluteLimitsTests-1717923510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f0b17ac8-dad4-4bbd-819c-8742e482630d tempest-AbsoluteLimitsTests-1717923510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f0b17ac8-dad4-4bbd-819c-8742e482630d tempest-AbsoluteLimitsTests-1717923510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:24 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:16:24 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:24 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a8ac5332-a3ce-4520-8641-71af480030c0 tempest-VolumesCloneTest-1755740488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d5befd52-4f7d-4250-8f95-da30b0d072ad" returned: 0 in 0.382s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a8ac5332-a3ce-4520-8641-71af480030c0 tempest-VolumesCloneTest-1755740488 None] Lock "cinder-quobyte-d5befd52-4f7d-4250-8f95-da30b0d072ad" released by "delete_volume" :: held 1.140s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-759e1726-cc3f-455b-94fb-23ab066480a0 req-f2c2248b-52a8-42b9-a5df-a8a7af0546db tempest-TestInstancesWithCinderVolumes-255478537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-a8ac5332-a3ce-4520-8641-71af480030c0 tempest-VolumesCloneTest-1755740488 None] Created reservations ['21f86013-0e7c-456f-9bfa-45cfae000016', 'ac198e4d-c2f4-460d-8702-15a53c0510b5', '799b082e-8552-41f0-b1df-13752f7393e9', 'f084bbc1-f57e-4e68-95ec-2e39a63ed193'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:16:24 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40e4335c-289d-4356-9fab-81f64711b94c 1073741824" returned: 0 in 0.614s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a8ac5332-a3ce-4520-8641-71af480030c0 tempest-VolumesCloneTest-1755740488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a8ac5332-a3ce-4520-8641-71af480030c0 tempest-VolumesCloneTest-1755740488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a8ac5332-a3ce-4520-8641-71af480030c0 tempest-VolumesCloneTest-1755740488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a8ac5332-a3ce-4520-8641-71af480030c0 tempest-VolumesCloneTest-1755740488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a8ac5332-a3ce-4520-8641-71af480030c0 tempest-VolumesCloneTest-1755740488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a8ac5332-a3ce-4520-8641-71af480030c0 tempest-VolumesCloneTest-1755740488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40e4335c-289d-4356-9fab-81f64711b94c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:24 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:16:24 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:24 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f0b17ac8-dad4-4bbd-819c-8742e482630d tempest-AbsoluteLimitsTests-1717923510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.339s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-f0b17ac8-dad4-4bbd-819c-8742e482630d tempest-AbsoluteLimitsTests-1717923510 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:16:24 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f0b17ac8-dad4-4bbd-819c-8742e482630d tempest-AbsoluteLimitsTests-1717923510 None] Deleted volume successfully. Sep 23 15:16:24 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40e4335c-289d-4356-9fab-81f64711b94c Sep 23 15:16:24 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f0b17ac8-dad4-4bbd-819c-8742e482630d tempest-AbsoluteLimitsTests-1717923510 None] Lock "cinder-b87d1033-c122-4e2b-8fac-d1871f3c9b65-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:24 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a8ac5332-a3ce-4520-8641-71af480030c0 tempest-VolumesCloneTest-1755740488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.272s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-a8ac5332-a3ce-4520-8641-71af480030c0 tempest-VolumesCloneTest-1755740488 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:16:24 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-a8ac5332-a3ce-4520-8641-71af480030c0 tempest-VolumesCloneTest-1755740488 None] Deleted volume successfully. Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a8ac5332-a3ce-4520-8641-71af480030c0 tempest-VolumesCloneTest-1755740488 None] Lock "cinder-d5befd52-4f7d-4250-8f95-da30b0d072ad-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:24 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40e4335c-289d-4356-9fab-81f64711b94c" returned: 0 in 0.316s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-759e1726-cc3f-455b-94fb-23ab066480a0 req-f2c2248b-52a8-42b9-a5df-a8a7af0546db tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.463s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a63ea5e-9f5b-4048-a5d6-81f2df0d2e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40e4335c-289d-4356-9fab-81f64711b94c', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cdd1b9e-6c7f-4a49-8ae2-8ff5484a03f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-759e1726-cc3f-455b-94fb-23ab066480a0 req-f2c2248b-52a8-42b9-a5df-a8a7af0546db tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:24 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Volume volume-40e4335c-289d-4356-9fab-81f64711b94c (40e4335c-289d-4356-9fab-81f64711b94c): created successfully Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cdd1b9e-6c7f-4a49-8ae2-8ff5484a03f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Flow 'volume_create_manager' (7227fbe3-0c7b-4714-87d7-11e169336689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:16:24 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-dc7f66c3-dc58-4986-8457-56c7eb4e74e0 tempest-VolumesTestJSON-212647168 None] Created volume successfully. Sep 23 15:16:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-759e1726-cc3f-455b-94fb-23ab066480a0 req-f2c2248b-52a8-42b9-a5df-a8a7af0546db tempest-TestInstancesWithCinderVolumes-255478537 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-7cb5fdab-67ef-477d-bca0-733c74bc767b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '056c9f88-0b67-43ef-aa77-154248d00ad9', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:16:25 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-759e1726-cc3f-455b-94fb-23ab066480a0 req-f2c2248b-52a8-42b9-a5df-a8a7af0546db tempest-TestInstancesWithCinderVolumes-255478537 None] attachment_update completed successfully. Sep 23 15:16:26 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:16:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Flow 'volume_create_manager' (414bdeef-cbd8-420b-8259-c6896648ad50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:16:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a07d3a-56c2-4061-87f0-4e6186885e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a07d3a-56c2-4061-87f0-4e6186885e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1236248831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298e83e9-a191-42da-86fd-54bb73f325a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='46db6db2d3fd4be8a942889ac252b5c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:16:26Z,use_quota=True,user_id='ceeaf7b970e744a8942ee3172f217f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441a28fa-147d-4b9d-8aac-2e7c746699de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441a28fa-147d-4b9d-8aac-2e7c746699de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff4a1f87-aa4f-4f9a-b747-644b346477b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff4a1f87-aa4f-4f9a-b747-644b346477b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '298e83e9-a191-42da-86fd-54bb73f325a0', 'volume_name': 'volume-298e83e9-a191-42da-86fd-54bb73f325a0', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f20c2c77-60d5-4050-89f2-f22b19c85704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f20c2c77-60d5-4050-89f2-f22b19c85704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dee936c-e487-4520-aa4d-08c19530a39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:26 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Volume 298e83e9-a191-42da-86fd-54bb73f325a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-298e83e9-a191-42da-86fd-54bb73f325a0', 'volume_size': 1} Sep 23 15:16:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1236248831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298e83e9-a191-42da-86fd-54bb73f325a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='46db6db2d3fd4be8a942889ac252b5c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:16:26Z,use_quota=True,user_id='ceeaf7b970e744a8942ee3172f217f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:16:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Creating volume 298e83e9-a191-42da-86fd-54bb73f325a0 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:16:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:16:26 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:16:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-298e83e9-a191-42da-86fd-54bb73f325a0 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:26 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-298e83e9-a191-42da-86fd-54bb73f325a0 1073741824 Sep 23 15:16:26 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:27 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-298e83e9-a191-42da-86fd-54bb73f325a0 1073741824" returned: 0 in 0.643s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-298e83e9-a191-42da-86fd-54bb73f325a0 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:27 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-298e83e9-a191-42da-86fd-54bb73f325a0 Sep 23 15:16:27 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:27 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-298e83e9-a191-42da-86fd-54bb73f325a0" returned: 0 in 0.365s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:27 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:16:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dee936c-e487-4520-aa4d-08c19530a39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-298e83e9-a191-42da-86fd-54bb73f325a0', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db99cf33-f5dd-44fc-ac0e-6ff929609467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:27 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Volume volume-298e83e9-a191-42da-86fd-54bb73f325a0 (298e83e9-a191-42da-86fd-54bb73f325a0): created successfully Sep 23 15:16:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db99cf33-f5dd-44fc-ac0e-6ff929609467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Flow 'volume_create_manager' (414bdeef-cbd8-420b-8259-c6896648ad50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:16:27 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-d10d913b-52ef-497b-9a42-8a8e31603cae tempest-VolumesTestJSON-212647168 None] Created volume successfully. Sep 23 15:16:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-28bc010f-815c-4ba7-892a-a376601ea07f tempest-VolumesTestJSON-212647168 None] Acquiring lock "cinder-298e83e9-a191-42da-86fd-54bb73f325a0-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-28bc010f-815c-4ba7-892a-a376601ea07f tempest-VolumesTestJSON-212647168 None] Lock "cinder-298e83e9-a191-42da-86fd-54bb73f325a0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-28bc010f-815c-4ba7-892a-a376601ea07f tempest-VolumesTestJSON-212647168 None] Acquiring lock "cinder-quobyte-298e83e9-a191-42da-86fd-54bb73f325a0" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-28bc010f-815c-4ba7-892a-a376601ea07f tempest-VolumesTestJSON-212647168 None] Lock "cinder-quobyte-298e83e9-a191-42da-86fd-54bb73f325a0" acquired by "delete_volume" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:30 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dacac8f-954e-496b-8ab0-30ee5746858e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-28bc010f-815c-4ba7-892a-a376601ea07f tempest-VolumesTestJSON-212647168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-298e83e9-a191-42da-86fd-54bb73f325a0 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:30 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-298e83e9-a191-42da-86fd-54bb73f325a0 Sep 23 15:16:30 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:31 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-28bc010f-815c-4ba7-892a-a376601ea07f tempest-VolumesTestJSON-212647168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-298e83e9-a191-42da-86fd-54bb73f325a0" returned: 0 in 0.574s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-28bc010f-815c-4ba7-892a-a376601ea07f tempest-VolumesTestJSON-212647168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-298e83e9-a191-42da-86fd-54bb73f325a0 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:31 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-298e83e9-a191-42da-86fd-54bb73f325a0 Sep 23 15:16:31 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Flow 'volume_create_manager' (6175a252-55a4-4df3-99a5-94ec6adb1d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e93858-41ed-45f2-b33d-3f555cf2d255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e93858-41ed-45f2-b33d-3f555cf2d255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1727370467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a96421-8ef6-47ab-a10b-f98b9f7e3005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0540df7a04434d1f9eec18f95bca065d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:16:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:16:31Z,use_quota=True,user_id='883e93d00ad04580a8a4d16ab3b1aacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ef53fd-97de-4b47-a820-ab2d5f0634ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ef53fd-97de-4b47-a820-ab2d5f0634ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b19f8e7-84ac-4dad-8304-71c3218800fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b19f8e7-84ac-4dad-8304-71c3218800fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5a96421-8ef6-47ab-a10b-f98b9f7e3005', 'volume_name': 'volume-e5a96421-8ef6-47ab-a10b-f98b9f7e3005', 'volume_size': 2}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c203b75-b1a9-4d57-b4dd-61f3bdc30147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c203b75-b1a9-4d57-b4dd-61f3bdc30147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf97193-4351-415c-9e65-31794bdf4780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:31 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Volume e5a96421-8ef6-47ab-a10b-f98b9f7e3005: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5a96421-8ef6-47ab-a10b-f98b9f7e3005', 'volume_size': 2} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1727370467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a96421-8ef6-47ab-a10b-f98b9f7e3005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0540df7a04434d1f9eec18f95bca065d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:16:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:16:31Z,use_quota=True,user_id='883e93d00ad04580a8a4d16ab3b1aacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Creating volume e5a96421-8ef6-47ab-a10b-f98b9f7e3005 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:16:31 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e5a96421-8ef6-47ab-a10b-f98b9f7e3005 2147483648 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:31 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e5a96421-8ef6-47ab-a10b-f98b9f7e3005 2147483648 Sep 23 15:16:31 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:31 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-28bc010f-815c-4ba7-892a-a376601ea07f tempest-VolumesTestJSON-212647168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-298e83e9-a191-42da-86fd-54bb73f325a0" returned: 0 in 0.397s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-28bc010f-815c-4ba7-892a-a376601ea07f tempest-VolumesTestJSON-212647168 None] Lock "cinder-quobyte-298e83e9-a191-42da-86fd-54bb73f325a0" released by "delete_volume" :: held 1.054s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-28bc010f-815c-4ba7-892a-a376601ea07f tempest-VolumesTestJSON-212647168 None] Created reservations ['88d56ea7-8b40-4e36-91e8-ffa880ad5504', 'ed4adee1-3782-46a9-83ce-e7cf70612d6b', '8ca1677e-5b65-424c-9efa-444d0a369a9c', '24777646-3e97-49a3-a727-4ec1b07f0889'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:16:31 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-576eb6d3-2cdc-4117-900f-668999acd713 req-658019ea-2fb1-49e6-8de7-293e1e0f1754 tempest-TestInstancesWithCinderVolumes-255478537 None] Terminate volume connection completed successfully. Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-576eb6d3-2cdc-4117-900f-668999acd713 req-658019ea-2fb1-49e6-8de7-293e1e0f1754 tempest-TestInstancesWithCinderVolumes-255478537 None] Deleting attachment 48b3d414-fac3-41d1-941f-862479b633df. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-28bc010f-815c-4ba7-892a-a376601ea07f tempest-VolumesTestJSON-212647168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-28bc010f-815c-4ba7-892a-a376601ea07f tempest-VolumesTestJSON-212647168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-28bc010f-815c-4ba7-892a-a376601ea07f tempest-VolumesTestJSON-212647168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-28bc010f-815c-4ba7-892a-a376601ea07f tempest-VolumesTestJSON-212647168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-28bc010f-815c-4ba7-892a-a376601ea07f tempest-VolumesTestJSON-212647168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-28bc010f-815c-4ba7-892a-a376601ea07f tempest-VolumesTestJSON-212647168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:31 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:16:31 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:31 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e5a96421-8ef6-47ab-a10b-f98b9f7e3005 2147483648" returned: 0 in 0.633s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e5a96421-8ef6-47ab-a10b-f98b9f7e3005 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:31 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e5a96421-8ef6-47ab-a10b-f98b9f7e3005 Sep 23 15:16:31 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:32 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-28bc010f-815c-4ba7-892a-a376601ea07f tempest-VolumesTestJSON-212647168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.344s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-28bc010f-815c-4ba7-892a-a376601ea07f tempest-VolumesTestJSON-212647168 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:16:32 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-28bc010f-815c-4ba7-892a-a376601ea07f tempest-VolumesTestJSON-212647168 None] Deleted volume successfully. Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-28bc010f-815c-4ba7-892a-a376601ea07f tempest-VolumesTestJSON-212647168 None] Lock "cinder-298e83e9-a191-42da-86fd-54bb73f325a0-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:16:32 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Flow 'volume_create_manager' (1b0822d2-caf4-4985-aeb7-c6db3ac73a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2918198-f534-4cc7-afcf-40121990adba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-dac1d6a8-31ab-44d7-84d9-476375a75cb6 tempest-TestInstancesWithCinderVolumes-255478537 None] Acquiring lock "cinder-97044aa9-cbee-423d-948c-0fe106c68972-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e5a96421-8ef6-47ab-a10b-f98b9f7e3005" returned: 0 in 0.385s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2918198-f534-4cc7-afcf-40121990adba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2051738937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459ffa9a-d8c9-435f-927b-b0a8f6727b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5c4c91db1174dff966f5a72491f60c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:16:32Z,use_quota=True,user_id='f68130b416b3439cb597efbd818074ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbfb6a7-1dcc-4aa7-8dbd-4f3b7b1c176f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbfb6a7-1dcc-4aa7-8dbd-4f3b7b1c176f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3ca488-11c6-4581-8ec9-d2307f5adc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3ca488-11c6-4581-8ec9-d2307f5adc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '459ffa9a-d8c9-435f-927b-b0a8f6727b63', 'volume_name': 'volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2902a96c-a74e-409d-9e17-cc8f754e3c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2902a96c-a74e-409d-9e17-cc8f754e3c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2990459c-15b0-45f4-bbb7-3fbf17688ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:32 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Volume 459ffa9a-d8c9-435f-927b-b0a8f6727b63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63', 'volume_size': 1} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2051738937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459ffa9a-d8c9-435f-927b-b0a8f6727b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5c4c91db1174dff966f5a72491f60c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:16:32Z,use_quota=True,user_id='f68130b416b3439cb597efbd818074ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Creating volume 459ffa9a-d8c9-435f-927b-b0a8f6727b63 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:16:32 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-dac1d6a8-31ab-44d7-84d9-476375a75cb6 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "cinder-97044aa9-cbee-423d-948c-0fe106c68972-delete_volume" acquired by "delete_volume" :: waited 0.145s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf97193-4351-415c-9e65-31794bdf4780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5a96421-8ef6-47ab-a10b-f98b9f7e3005', 'volume_size': 2}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6588e99-ca3f-47c8-baa1-8add98dd805b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:32 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 1073741824 Sep 23 15:16:32 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:32 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Volume volume-e5a96421-8ef6-47ab-a10b-f98b9f7e3005 (e5a96421-8ef6-47ab-a10b-f98b9f7e3005): created successfully Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6588e99-ca3f-47c8-baa1-8add98dd805b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Flow 'volume_create_manager' (6175a252-55a4-4df3-99a5-94ec6adb1d69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-dac1d6a8-31ab-44d7-84d9-476375a75cb6 tempest-TestInstancesWithCinderVolumes-255478537 None] Acquiring lock "cinder-quobyte-97044aa9-cbee-423d-948c-0fe106c68972" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:32 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-2d5192e5-2a0e-4bec-805f-5631df70cb3b tempest-VolumesCloneNegativeTest-963999927 None] Created volume successfully. Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-dac1d6a8-31ab-44d7-84d9-476375a75cb6 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "cinder-quobyte-97044aa9-cbee-423d-948c-0fe106c68972" acquired by "delete_volume" :: waited 0.031s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a9dd45-1349-4e70-a462-8822a251d6cf]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dac1d6a8-31ab-44d7-84d9-476375a75cb6 tempest-TestInstancesWithCinderVolumes-255478537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-97044aa9-cbee-423d-948c-0fe106c68972 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0f6a9250-662b-4a80-bdcb-66c96c15cfdc tempest-VolumesTestJSON-212647168 None] Acquiring lock "cinder-40e4335c-289d-4356-9fab-81f64711b94c-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0f6a9250-662b-4a80-bdcb-66c96c15cfdc tempest-VolumesTestJSON-212647168 None] Lock "cinder-40e4335c-289d-4356-9fab-81f64711b94c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0f6a9250-662b-4a80-bdcb-66c96c15cfdc tempest-VolumesTestJSON-212647168 None] Acquiring lock "cinder-quobyte-40e4335c-289d-4356-9fab-81f64711b94c" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0f6a9250-662b-4a80-bdcb-66c96c15cfdc tempest-VolumesTestJSON-212647168 None] Lock "cinder-quobyte-40e4335c-289d-4356-9fab-81f64711b94c" acquired by "delete_volume" :: waited 0.021s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9424054b-a442-414f-9851-d1e852409918]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f6a9250-662b-4a80-bdcb-66c96c15cfdc tempest-VolumesTestJSON-212647168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40e4335c-289d-4356-9fab-81f64711b94c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:32 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-97044aa9-cbee-423d-948c-0fe106c68972 Sep 23 15:16:32 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:32 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40e4335c-289d-4356-9fab-81f64711b94c Sep 23 15:16:32 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:33 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 1073741824" returned: 0 in 0.610s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:33 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 Sep 23 15:16:33 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:33 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dac1d6a8-31ab-44d7-84d9-476375a75cb6 tempest-TestInstancesWithCinderVolumes-255478537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-97044aa9-cbee-423d-948c-0fe106c68972" returned: 0 in 0.576s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dac1d6a8-31ab-44d7-84d9-476375a75cb6 tempest-TestInstancesWithCinderVolumes-255478537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-97044aa9-cbee-423d-948c-0fe106c68972 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:33 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-97044aa9-cbee-423d-948c-0fe106c68972 Sep 23 15:16:33 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:33 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f6a9250-662b-4a80-bdcb-66c96c15cfdc tempest-VolumesTestJSON-212647168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40e4335c-289d-4356-9fab-81f64711b94c" returned: 0 in 0.620s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f6a9250-662b-4a80-bdcb-66c96c15cfdc tempest-VolumesTestJSON-212647168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40e4335c-289d-4356-9fab-81f64711b94c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:33 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63" returned: 0 in 0.360s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:33 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40e4335c-289d-4356-9fab-81f64711b94c Sep 23 15:16:33 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6c4a9c2f-aa44-4cde-b805-e8a9f38b0937 tempest-VolumesCloneNegativeTest-963999927 None] Acquiring lock "cinder-e5a96421-8ef6-47ab-a10b-f98b9f7e3005-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2990459c-15b0-45f4-bbb7-3fbf17688ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6348950-8b06-4f82-aa0e-be3310a3b6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6c4a9c2f-aa44-4cde-b805-e8a9f38b0937 tempest-VolumesCloneNegativeTest-963999927 None] Lock "cinder-e5a96421-8ef6-47ab-a10b-f98b9f7e3005-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:33 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Volume volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 (459ffa9a-d8c9-435f-927b-b0a8f6727b63): created successfully Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6348950-8b06-4f82-aa0e-be3310a3b6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Flow 'volume_create_manager' (1b0822d2-caf4-4985-aeb7-c6db3ac73a80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:16:33 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-ba6473cc-0b44-4a8d-9fc9-467bb00a8a34 tempest-VolumesDeleteCascade-1624468918 None] Created volume successfully. Sep 23 15:16:33 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6c4a9c2f-aa44-4cde-b805-e8a9f38b0937 tempest-VolumesCloneNegativeTest-963999927 None] Acquiring lock "cinder-quobyte-e5a96421-8ef6-47ab-a10b-f98b9f7e3005" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dac1d6a8-31ab-44d7-84d9-476375a75cb6 tempest-TestInstancesWithCinderVolumes-255478537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-97044aa9-cbee-423d-948c-0fe106c68972" returned: 0 in 0.454s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-dac1d6a8-31ab-44d7-84d9-476375a75cb6 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "cinder-quobyte-97044aa9-cbee-423d-948c-0fe106c68972" released by "delete_volume" :: held 1.103s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6c4a9c2f-aa44-4cde-b805-e8a9f38b0937 tempest-VolumesCloneNegativeTest-963999927 None] Lock "cinder-quobyte-e5a96421-8ef6-47ab-a10b-f98b9f7e3005" acquired by "delete_volume" :: waited 0.027s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddead745-2464-4412-a919-8728521cc6a1]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6c4a9c2f-aa44-4cde-b805-e8a9f38b0937 tempest-VolumesCloneNegativeTest-963999927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e5a96421-8ef6-47ab-a10b-f98b9f7e3005 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:33 devstack cinder-volume[86064]: WARNING cinder.quota [None req-dac1d6a8-31ab-44d7-84d9-476375a75cb6 tempest-TestInstancesWithCinderVolumes-255478537 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1096762522-1763419304 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1096762522-1763419304, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:16:33 devstack cinder-volume[86064]: WARNING cinder.quota [None req-dac1d6a8-31ab-44d7-84d9-476375a75cb6 tempest-TestInstancesWithCinderVolumes-255478537 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1096762522-1763419304 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1096762522-1763419304, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-dac1d6a8-31ab-44d7-84d9-476375a75cb6 tempest-TestInstancesWithCinderVolumes-255478537 None] Created reservations ['4ce665ae-4a51-49fe-bea8-32b38b8fdf9f', '370a82a2-e49b-401f-88d2-68b656c3534e', 'c3000b67-db38-4efc-a56c-78b998a5077c', '79577b48-4eb1-4275-bbe1-7592ab23cfa0'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:16:33 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f6a9250-662b-4a80-bdcb-66c96c15cfdc tempest-VolumesTestJSON-212647168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40e4335c-289d-4356-9fab-81f64711b94c" returned: 0 in 0.381s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0f6a9250-662b-4a80-bdcb-66c96c15cfdc tempest-VolumesTestJSON-212647168 None] Lock "cinder-quobyte-40e4335c-289d-4356-9fab-81f64711b94c" released by "delete_volume" :: held 1.065s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:33 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e5a96421-8ef6-47ab-a10b-f98b9f7e3005 Sep 23 15:16:33 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-dac1d6a8-31ab-44d7-84d9-476375a75cb6 tempest-TestInstancesWithCinderVolumes-255478537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-dac1d6a8-31ab-44d7-84d9-476375a75cb6 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-dac1d6a8-31ab-44d7-84d9-476375a75cb6 tempest-TestInstancesWithCinderVolumes-255478537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-dac1d6a8-31ab-44d7-84d9-476375a75cb6 tempest-TestInstancesWithCinderVolumes-255478537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-dac1d6a8-31ab-44d7-84d9-476375a75cb6 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dac1d6a8-31ab-44d7-84d9-476375a75cb6 tempest-TestInstancesWithCinderVolumes-255478537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:33 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:16:33 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:33 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-0f6a9250-662b-4a80-bdcb-66c96c15cfdc tempest-VolumesTestJSON-212647168 None] Created reservations ['dfb75090-b210-4695-9b1e-d6cf57d70aca', '28142e99-0dd1-4076-8c04-057277fd9992', '0dddb4ed-9c48-4e7a-a4e1-54eebec193da', '9ab91a71-ab9f-4f1a-9017-50920e136acd'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0f6a9250-662b-4a80-bdcb-66c96c15cfdc tempest-VolumesTestJSON-212647168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0f6a9250-662b-4a80-bdcb-66c96c15cfdc tempest-VolumesTestJSON-212647168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0f6a9250-662b-4a80-bdcb-66c96c15cfdc tempest-VolumesTestJSON-212647168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0f6a9250-662b-4a80-bdcb-66c96c15cfdc tempest-VolumesTestJSON-212647168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0f6a9250-662b-4a80-bdcb-66c96c15cfdc tempest-VolumesTestJSON-212647168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f6a9250-662b-4a80-bdcb-66c96c15cfdc tempest-VolumesTestJSON-212647168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:34 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:16:34 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:34 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6c4a9c2f-aa44-4cde-b805-e8a9f38b0937 tempest-VolumesCloneNegativeTest-963999927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e5a96421-8ef6-47ab-a10b-f98b9f7e3005" returned: 0 in 0.505s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:34 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6c4a9c2f-aa44-4cde-b805-e8a9f38b0937 tempest-VolumesCloneNegativeTest-963999927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e5a96421-8ef6-47ab-a10b-f98b9f7e3005 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dac1d6a8-31ab-44d7-84d9-476375a75cb6 tempest-TestInstancesWithCinderVolumes-255478537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.333s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-dac1d6a8-31ab-44d7-84d9-476375a75cb6 tempest-TestInstancesWithCinderVolumes-255478537 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:16:34 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-dac1d6a8-31ab-44d7-84d9-476375a75cb6 tempest-TestInstancesWithCinderVolumes-255478537 None] Deleted volume successfully. Sep 23 15:16:34 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e5a96421-8ef6-47ab-a10b-f98b9f7e3005 Sep 23 15:16:34 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-dac1d6a8-31ab-44d7-84d9-476375a75cb6 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "cinder-97044aa9-cbee-423d-948c-0fe106c68972-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:34 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0f6a9250-662b-4a80-bdcb-66c96c15cfdc tempest-VolumesTestJSON-212647168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.344s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-0f6a9250-662b-4a80-bdcb-66c96c15cfdc tempest-VolumesTestJSON-212647168 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:16:34 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-0f6a9250-662b-4a80-bdcb-66c96c15cfdc tempest-VolumesTestJSON-212647168 None] Deleted volume successfully. Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0f6a9250-662b-4a80-bdcb-66c96c15cfdc tempest-VolumesTestJSON-212647168 None] Lock "cinder-40e4335c-289d-4356-9fab-81f64711b94c-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:34 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6c4a9c2f-aa44-4cde-b805-e8a9f38b0937 tempest-VolumesCloneNegativeTest-963999927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e5a96421-8ef6-47ab-a10b-f98b9f7e3005" returned: 0 in 0.315s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6c4a9c2f-aa44-4cde-b805-e8a9f38b0937 tempest-VolumesCloneNegativeTest-963999927 None] Lock "cinder-quobyte-e5a96421-8ef6-47ab-a10b-f98b9f7e3005" released by "delete_volume" :: held 0.871s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-6c4a9c2f-aa44-4cde-b805-e8a9f38b0937 tempest-VolumesCloneNegativeTest-963999927 None] Created reservations ['e0e945d4-c9a6-4b76-9734-7b09fa9b3b5e', 'fa721dd4-1df7-4b7f-87e8-761ffa820252', '9a6598c4-df84-4eab-85cb-2560535dcdfe', '6be41130-4f13-46d4-aae8-2853390d8146'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-61221ade-3072-4fe8-88df-90c5932f04f9 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-61221ade-3072-4fe8-88df-90c5932f04f9 tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-61221ade-3072-4fe8-88df-90c5932f04f9 tempest-VolumesDeleteCascade-1624468918 None] Creating offline snapshot 2985f4c9-7479-4a6e-8a72-02ccb2f68a99 of volume 459ffa9a-d8c9-435f-927b-b0a8f6727b63 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6c4a9c2f-aa44-4cde-b805-e8a9f38b0937 tempest-VolumesCloneNegativeTest-963999927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6c4a9c2f-aa44-4cde-b805-e8a9f38b0937 tempest-VolumesCloneNegativeTest-963999927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6c4a9c2f-aa44-4cde-b805-e8a9f38b0937 tempest-VolumesCloneNegativeTest-963999927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6c4a9c2f-aa44-4cde-b805-e8a9f38b0937 tempest-VolumesCloneNegativeTest-963999927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6c4a9c2f-aa44-4cde-b805-e8a9f38b0937 tempest-VolumesCloneNegativeTest-963999927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6c4a9c2f-aa44-4cde-b805-e8a9f38b0937 tempest-VolumesCloneNegativeTest-963999927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[288da00d-fcfc-4d4e-94be-faba3ca18f39]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-61221ade-3072-4fe8-88df-90c5932f04f9 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:34 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:16:34 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:34 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 Sep 23 15:16:34 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-47484af6-b192-4fb9-af6d-ca620c30c528 tempest-VolumesTestJSON-212647168 None] Acquiring lock "cinder-bf4409a8-5ea9-4f21-b50e-22398dfd5e3f-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-47484af6-b192-4fb9-af6d-ca620c30c528 tempest-VolumesTestJSON-212647168 None] Lock "cinder-bf4409a8-5ea9-4f21-b50e-22398dfd5e3f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:35 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6c4a9c2f-aa44-4cde-b805-e8a9f38b0937 tempest-VolumesCloneNegativeTest-963999927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.419s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:35 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-6c4a9c2f-aa44-4cde-b805-e8a9f38b0937 tempest-VolumesCloneNegativeTest-963999927 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:16:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-47484af6-b192-4fb9-af6d-ca620c30c528 tempest-VolumesTestJSON-212647168 None] Acquiring lock "cinder-quobyte-bf4409a8-5ea9-4f21-b50e-22398dfd5e3f" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:35 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-6c4a9c2f-aa44-4cde-b805-e8a9f38b0937 tempest-VolumesCloneNegativeTest-963999927 None] Deleted volume successfully. Sep 23 15:16:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-47484af6-b192-4fb9-af6d-ca620c30c528 tempest-VolumesTestJSON-212647168 None] Lock "cinder-quobyte-bf4409a8-5ea9-4f21-b50e-22398dfd5e3f" acquired by "delete_volume" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6c4a9c2f-aa44-4cde-b805-e8a9f38b0937 tempest-VolumesCloneNegativeTest-963999927 None] Lock "cinder-e5a96421-8ef6-47ab-a10b-f98b9f7e3005-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:35 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[521323ea-16e5-4a7b-93b3-69b2ac149f32]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-47484af6-b192-4fb9-af6d-ca620c30c528 tempest-VolumesTestJSON-212647168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bf4409a8-5ea9-4f21-b50e-22398dfd5e3f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:35 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-61221ade-3072-4fe8-88df-90c5932f04f9 tempest-VolumesDeleteCascade-1624468918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63" returned: 0 in 0.615s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-61221ade-3072-4fe8-88df-90c5932f04f9 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:35 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bf4409a8-5ea9-4f21-b50e-22398dfd5e3f Sep 23 15:16:35 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:35 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99 1G Sep 23 15:16:35 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:35 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-47484af6-b192-4fb9-af6d-ca620c30c528 tempest-VolumesTestJSON-212647168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bf4409a8-5ea9-4f21-b50e-22398dfd5e3f" returned: 0 in 0.487s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-47484af6-b192-4fb9-af6d-ca620c30c528 tempest-VolumesTestJSON-212647168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bf4409a8-5ea9-4f21-b50e-22398dfd5e3f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:35 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bf4409a8-5ea9-4f21-b50e-22398dfd5e3f Sep 23 15:16:35 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:35 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-61221ade-3072-4fe8-88df-90c5932f04f9 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99 1G" returned: 0 in 0.521s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-61221ade-3072-4fe8-88df-90c5932f04f9 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:35 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99 Sep 23 15:16:35 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:36 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-47484af6-b192-4fb9-af6d-ca620c30c528 tempest-VolumesTestJSON-212647168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bf4409a8-5ea9-4f21-b50e-22398dfd5e3f" returned: 0 in 0.301s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-47484af6-b192-4fb9-af6d-ca620c30c528 tempest-VolumesTestJSON-212647168 None] Lock "cinder-quobyte-bf4409a8-5ea9-4f21-b50e-22398dfd5e3f" released by "delete_volume" :: held 0.880s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:36 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:16:36 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-47484af6-b192-4fb9-af6d-ca620c30c528 tempest-VolumesTestJSON-212647168 None] Created reservations ['1a347d87-13f3-4337-b551-68e31ded0854', 'babbaa15-a06b-46f2-b0e8-1825a7f2a40b', 'f0b66355-9f70-4efe-a397-945ce4cae180', 'cee7f66b-be4f-4f8b-9636-15d480be93ba'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-47484af6-b192-4fb9-af6d-ca620c30c528 tempest-VolumesTestJSON-212647168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-47484af6-b192-4fb9-af6d-ca620c30c528 tempest-VolumesTestJSON-212647168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-47484af6-b192-4fb9-af6d-ca620c30c528 tempest-VolumesTestJSON-212647168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:36 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-47484af6-b192-4fb9-af6d-ca620c30c528 tempest-VolumesTestJSON-212647168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-47484af6-b192-4fb9-af6d-ca620c30c528 tempest-VolumesTestJSON-212647168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-47484af6-b192-4fb9-af6d-ca620c30c528 tempest-VolumesTestJSON-212647168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-61221ade-3072-4fe8-88df-90c5932f04f9 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99" returned: 0 in 0.529s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:36 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-61221ade-3072-4fe8-88df-90c5932f04f9 tempest-VolumesDeleteCascade-1624468918 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99 is being set with open permissions: ugo+rw Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-61221ade-3072-4fe8-88df-90c5932f04f9 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:36 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:16:36 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:36 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99 Sep 23 15:16:36 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:36 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.392s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 28 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:16:36 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-47484af6-b192-4fb9-af6d-ca620c30c528 tempest-VolumesTestJSON-212647168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.356s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-47484af6-b192-4fb9-af6d-ca620c30c528 tempest-VolumesTestJSON-212647168 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:16:36 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-47484af6-b192-4fb9-af6d-ca620c30c528 tempest-VolumesTestJSON-212647168 None] Deleted volume successfully. Sep 23 15:16:36 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-61221ade-3072-4fe8-88df-90c5932f04f9 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99" returned: 0 in 0.361s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-47484af6-b192-4fb9-af6d-ca620c30c528 tempest-VolumesTestJSON-212647168 None] Lock "cinder-bf4409a8-5ea9-4f21-b50e-22398dfd5e3f-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-61221ade-3072-4fe8-88df-90c5932f04f9 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:36 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.info Sep 23 15:16:36 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:37 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-61221ade-3072-4fe8-88df-90c5932f04f9 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.info" returned: 0 in 0.298s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:37 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-61221ade-3072-4fe8-88df-90c5932f04f9 tempest-VolumesDeleteCascade-1624468918 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.info is being set with open permissions: ugo+rw Sep 23 15:16:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-61221ade-3072-4fe8-88df-90c5932f04f9 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:37 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.info Sep 23 15:16:37 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:37 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-4fd09ba2-98b1-4bf0-b326-d135207c4c0f req-dce24fa7-7429-4bad-b8e8-fa59995843b5 tempest-TestInstancesWithCinderVolumes-255478537 None] Terminate volume connection completed successfully. Sep 23 15:16:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-4fd09ba2-98b1-4bf0-b326-d135207c4c0f req-dce24fa7-7429-4bad-b8e8-fa59995843b5 tempest-TestInstancesWithCinderVolumes-255478537 None] Deleting attachment 056c9f88-0b67-43ef-aa77-154248d00ad9. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:16:37 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-61221ade-3072-4fe8-88df-90c5932f04f9 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.info" returned: 0 in 0.309s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-61221ade-3072-4fe8-88df-90c5932f04f9 tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.805s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:37 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-61221ade-3072-4fe8-88df-90c5932f04f9 tempest-VolumesDeleteCascade-1624468918 None] Create snapshot completed successfully Sep 23 15:16:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e5f215ea-ad6b-4fce-931a-f2a6708ab8d1 tempest-TestInstancesWithCinderVolumes-255478537 None] Acquiring lock "cinder-7cb5fdab-67ef-477d-bca0-733c74bc767b-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e5f215ea-ad6b-4fce-931a-f2a6708ab8d1 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "cinder-7cb5fdab-67ef-477d-bca0-733c74bc767b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e5f215ea-ad6b-4fce-931a-f2a6708ab8d1 tempest-TestInstancesWithCinderVolumes-255478537 None] Acquiring lock "cinder-quobyte-7cb5fdab-67ef-477d-bca0-733c74bc767b" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e5f215ea-ad6b-4fce-931a-f2a6708ab8d1 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "cinder-quobyte-7cb5fdab-67ef-477d-bca0-733c74bc767b" acquired by "delete_volume" :: waited 0.034s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:38 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[261acedf-518d-42e3-96a4-2eda4862fee1]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e5f215ea-ad6b-4fce-931a-f2a6708ab8d1 tempest-TestInstancesWithCinderVolumes-255478537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7cb5fdab-67ef-477d-bca0-733c74bc767b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-49a16eb4-7d3f-4ee6-a8e7-8d640aa5b9f2 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-49a16eb4-7d3f-4ee6-a8e7-8d640aa5b9f2 tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-49a16eb4-7d3f-4ee6-a8e7-8d640aa5b9f2 tempest-VolumesDeleteCascade-1624468918 None] Creating offline snapshot d90381c4-fbd1-4003-872d-0bad11e0771e of volume 459ffa9a-d8c9-435f-927b-b0a8f6727b63 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:16:38 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8c0040-187c-4737-913f-884d67573bf5]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-49a16eb4-7d3f-4ee6-a8e7-8d640aa5b9f2 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:38 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7cb5fdab-67ef-477d-bca0-733c74bc767b Sep 23 15:16:38 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:38 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99 Sep 23 15:16:38 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:38 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e5f215ea-ad6b-4fce-931a-f2a6708ab8d1 tempest-TestInstancesWithCinderVolumes-255478537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7cb5fdab-67ef-477d-bca0-733c74bc767b" returned: 0 in 0.567s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e5f215ea-ad6b-4fce-931a-f2a6708ab8d1 tempest-TestInstancesWithCinderVolumes-255478537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7cb5fdab-67ef-477d-bca0-733c74bc767b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:38 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7cb5fdab-67ef-477d-bca0-733c74bc767b Sep 23 15:16:38 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:38 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-49a16eb4-7d3f-4ee6-a8e7-8d640aa5b9f2 tempest-VolumesDeleteCascade-1624468918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99" returned: 0 in 0.586s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-49a16eb4-7d3f-4ee6-a8e7-8d640aa5b9f2 tempest-VolumesDeleteCascade-1624468918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:16:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-49a16eb4-7d3f-4ee6-a8e7-8d640aa5b9f2 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:38 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e 1G Sep 23 15:16:38 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:39 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e5f215ea-ad6b-4fce-931a-f2a6708ab8d1 tempest-TestInstancesWithCinderVolumes-255478537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7cb5fdab-67ef-477d-bca0-733c74bc767b" returned: 0 in 0.380s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e5f215ea-ad6b-4fce-931a-f2a6708ab8d1 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "cinder-quobyte-7cb5fdab-67ef-477d-bca0-733c74bc767b" released by "delete_volume" :: held 1.046s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:39 devstack cinder-volume[86064]: WARNING cinder.quota [None req-e5f215ea-ad6b-4fce-931a-f2a6708ab8d1 tempest-TestInstancesWithCinderVolumes-255478537 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1424933090-174083791 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1424933090-174083791, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:16:39 devstack cinder-volume[86064]: WARNING cinder.quota [None req-e5f215ea-ad6b-4fce-931a-f2a6708ab8d1 tempest-TestInstancesWithCinderVolumes-255478537 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1424933090-174083791 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1424933090-174083791, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:16:39 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-e5f215ea-ad6b-4fce-931a-f2a6708ab8d1 tempest-TestInstancesWithCinderVolumes-255478537 None] Created reservations ['5fe0fc5b-3dc9-4449-8555-7812cc6e088b', '3e096de4-6083-42cc-9d1a-7b38e832d509', '253cbf23-0724-4752-9c26-8ce656b9e36b', '95531e50-f37f-44b5-8d40-0d677e766d12'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:16:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e5f215ea-ad6b-4fce-931a-f2a6708ab8d1 tempest-TestInstancesWithCinderVolumes-255478537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e5f215ea-ad6b-4fce-931a-f2a6708ab8d1 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e5f215ea-ad6b-4fce-931a-f2a6708ab8d1 tempest-TestInstancesWithCinderVolumes-255478537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e5f215ea-ad6b-4fce-931a-f2a6708ab8d1 tempest-TestInstancesWithCinderVolumes-255478537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e5f215ea-ad6b-4fce-931a-f2a6708ab8d1 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e5f215ea-ad6b-4fce-931a-f2a6708ab8d1 tempest-TestInstancesWithCinderVolumes-255478537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:39 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:16:39 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:39 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-49a16eb4-7d3f-4ee6-a8e7-8d640aa5b9f2 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e 1G" returned: 0 in 0.756s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-49a16eb4-7d3f-4ee6-a8e7-8d640aa5b9f2 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:39 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e5f215ea-ad6b-4fce-931a-f2a6708ab8d1 tempest-TestInstancesWithCinderVolumes-255478537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.343s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:39 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-e5f215ea-ad6b-4fce-931a-f2a6708ab8d1 tempest-TestInstancesWithCinderVolumes-255478537 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:16:39 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-e5f215ea-ad6b-4fce-931a-f2a6708ab8d1 tempest-TestInstancesWithCinderVolumes-255478537 None] Deleted volume successfully. Sep 23 15:16:39 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e Sep 23 15:16:39 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e5f215ea-ad6b-4fce-931a-f2a6708ab8d1 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "cinder-7cb5fdab-67ef-477d-bca0-733c74bc767b-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:40 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-49a16eb4-7d3f-4ee6-a8e7-8d640aa5b9f2 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e" returned: 0 in 0.370s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:40 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-49a16eb4-7d3f-4ee6-a8e7-8d640aa5b9f2 tempest-VolumesDeleteCascade-1624468918 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e is being set with open permissions: ugo+rw Sep 23 15:16:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-49a16eb4-7d3f-4ee6-a8e7-8d640aa5b9f2 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:40 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e Sep 23 15:16:40 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:40 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-49a16eb4-7d3f-4ee6-a8e7-8d640aa5b9f2 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e" returned: 0 in 0.436s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-49a16eb4-7d3f-4ee6-a8e7-8d640aa5b9f2 tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.318s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:40 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-49a16eb4-7d3f-4ee6-a8e7-8d640aa5b9f2 tempest-VolumesDeleteCascade-1624468918 None] Create snapshot completed successfully Sep 23 15:16:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "cinder-459ffa9a-d8c9-435f-927b-b0a8f6727b63-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-459ffa9a-d8c9-435f-927b-b0a8f6727b63-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:41 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Performing cascade delete. {{(pid=86064) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 23 15:16:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "cinder-2985f4c9-7479-4a6e-8a72-02ccb2f68a99-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-2985f4c9-7479-4a6e-8a72-02ccb2f68a99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "cinder-quobyte-459ffa9a-d8c9-435f-927b-b0a8f6727b63" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-quobyte-459ffa9a-d8c9-435f-927b-b0a8f6727b63" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "cinder-quobyte-2985f4c9-7479-4a6e-8a72-02ccb2f68a99" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-quobyte-2985f4c9-7479-4a6e-8a72-02ccb2f68a99" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:41 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Deleting offline snapshot 2985f4c9-7479-4a6e-8a72-02ccb2f68a99 of volume 459ffa9a-d8c9-435f-927b-b0a8f6727b63 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:16:41 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] snapshot_file for this snap is: volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:16:41 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4050ea7-0cc6-4e2b-aca5-a57653b2bc3a]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:41 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99 Sep 23 15:16:41 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:42 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99" returned: 0 in 0.495s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:42 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:16:42 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56ff5ba-181e-4518-8c3f-866a9f68b583]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:42 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 Sep 23 15:16:42 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:43 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63" returned: 0 in 0.696s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:43 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[117bcfd8-26db-4ea2-932d-d0f2ef7850bc]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:43 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e Sep 23 15:16:43 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:43 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e" returned: 0 in 0.724s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:43 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:16:43 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d51822-5bd1-40d6-9e7f-9e41064786f4]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:44 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99 Sep 23 15:16:44 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:44 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99" returned: 0 in 0.533s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:44 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:16:44 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15d3cf5-beb8-45d9-b24b-0d55d9e6a75a]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:44 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 Sep 23 15:16:44 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:44 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-2ac87f40-91ce-4886-b3d4-ea7eb3b171e2 req-de432aea-0401-44fa-a8c9-13bbb9484ee4 tempest-TestInstancesWithCinderVolumes-255478537 None] Terminate volume connection completed successfully. Sep 23 15:16:44 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-2ac87f40-91ce-4886-b3d4-ea7eb3b171e2 req-de432aea-0401-44fa-a8c9-13bbb9484ee4 tempest-TestInstancesWithCinderVolumes-255478537 None] Deleting attachment 3feef35c-1aa2-44e5-9c2b-1b577c6ac5f7. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:16:44 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63" returned: 0 in 0.535s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:45 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99 Sep 23 15:16:45 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:45 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99" returned: 0 in 0.612s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:45 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99 Sep 23 15:16:45 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:45 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.2985f4c9-7479-4a6e-8a72-02ccb2f68a99" returned: 0 in 0.328s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e -F qcow2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:45 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e -F qcow2 Sep 23 15:16:45 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:46 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e -F qcow2" returned: 0 in 0.518s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-quobyte-2985f4c9-7479-4a6e-8a72-02ccb2f68a99" released by "_delete_snapshot" :: held 4.780s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-quobyte-459ffa9a-d8c9-435f-927b-b0a8f6727b63" released by "delete_snapshot" :: held 4.830s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:46 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Created reservations ['f83b1b6c-f3da-4991-be8b-6f3ecba2d1ca', '3082dfab-d8e4-467c-b919-b063bece551c', '34bb55a1-4480-43b8-a255-f4a2820aa300', '07c09795-4b64-48de-ae8b-3dc806934af4'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:16:46 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Delete snapshot completed successfully. Sep 23 15:16:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-2985f4c9-7479-4a6e-8a72-02ccb2f68a99-delete_snapshot" released by "delete_snapshot" :: held 5.054s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "cinder-d90381c4-fbd1-4003-872d-0bad11e0771e-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-d90381c4-fbd1-4003-872d-0bad11e0771e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "cinder-quobyte-459ffa9a-d8c9-435f-927b-b0a8f6727b63" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-quobyte-459ffa9a-d8c9-435f-927b-b0a8f6727b63" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "cinder-quobyte-d90381c4-fbd1-4003-872d-0bad11e0771e" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-quobyte-d90381c4-fbd1-4003-872d-0bad11e0771e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Deleting offline snapshot d90381c4-fbd1-4003-872d-0bad11e0771e of volume 459ffa9a-d8c9-435f-927b-b0a8f6727b63 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:16:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] snapshot_file for this snap is: volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:16:46 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[422bb687-aa62-4ade-95f3-b0148cf98513]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:46 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e Sep 23 15:16:46 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:47 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e56941d7-cac1-493f-a482-c251aba35879 tempest-TestInstancesWithCinderVolumes-255478537 None] Acquiring lock "cinder-26787467-14fb-4099-88ff-5d72fc3ec25e-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:47 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e56941d7-cac1-493f-a482-c251aba35879 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "cinder-26787467-14fb-4099-88ff-5d72fc3ec25e-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:47 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e56941d7-cac1-493f-a482-c251aba35879 tempest-TestInstancesWithCinderVolumes-255478537 None] Acquiring lock "cinder-quobyte-26787467-14fb-4099-88ff-5d72fc3ec25e" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:47 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e56941d7-cac1-493f-a482-c251aba35879 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "cinder-quobyte-26787467-14fb-4099-88ff-5d72fc3ec25e" acquired by "delete_volume" :: waited 0.038s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:47 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e63af42-4ed6-44d8-8de9-8ef580932ae5]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e56941d7-cac1-493f-a482-c251aba35879 tempest-TestInstancesWithCinderVolumes-255478537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-26787467-14fb-4099-88ff-5d72fc3ec25e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:47 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-26787467-14fb-4099-88ff-5d72fc3ec25e Sep 23 15:16:47 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:47 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e" returned: 0 in 0.732s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:47 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:16:47 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[de991293-9652-4e86-a660-b248af40b730]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:47 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e56941d7-cac1-493f-a482-c251aba35879 tempest-TestInstancesWithCinderVolumes-255478537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-26787467-14fb-4099-88ff-5d72fc3ec25e" returned: 0 in 0.563s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e56941d7-cac1-493f-a482-c251aba35879 tempest-TestInstancesWithCinderVolumes-255478537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-26787467-14fb-4099-88ff-5d72fc3ec25e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:47 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 Sep 23 15:16:47 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:47 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-26787467-14fb-4099-88ff-5d72fc3ec25e Sep 23 15:16:47 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:48 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e56941d7-cac1-493f-a482-c251aba35879 tempest-TestInstancesWithCinderVolumes-255478537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-26787467-14fb-4099-88ff-5d72fc3ec25e" returned: 0 in 0.410s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:48 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e56941d7-cac1-493f-a482-c251aba35879 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "cinder-quobyte-26787467-14fb-4099-88ff-5d72fc3ec25e" released by "delete_volume" :: held 1.061s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:48 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63" returned: 0 in 0.726s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:48 devstack cinder-volume[86064]: WARNING cinder.quota [None req-e56941d7-cac1-493f-a482-c251aba35879 tempest-TestInstancesWithCinderVolumes-255478537 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1061627324-1606067401 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1061627324-1606067401, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:16:48 devstack cinder-volume[86064]: WARNING cinder.quota [None req-e56941d7-cac1-493f-a482-c251aba35879 tempest-TestInstancesWithCinderVolumes-255478537 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1061627324-1606067401 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1061627324-1606067401, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:16:48 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e Sep 23 15:16:48 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:48 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-e56941d7-cac1-493f-a482-c251aba35879 tempest-TestInstancesWithCinderVolumes-255478537 None] Created reservations ['cbb1bfd5-7164-4ef6-9b1f-4565a9e08d65', '87fd4d49-67ca-4ef5-bcad-95b80fa66965', '831e2f3d-4b83-4417-8f05-75fc58b94128', 'ac37f20a-1829-4e5e-b165-d59b4cae23c1'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:16:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e56941d7-cac1-493f-a482-c251aba35879 tempest-TestInstancesWithCinderVolumes-255478537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e56941d7-cac1-493f-a482-c251aba35879 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e56941d7-cac1-493f-a482-c251aba35879 tempest-TestInstancesWithCinderVolumes-255478537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e56941d7-cac1-493f-a482-c251aba35879 tempest-TestInstancesWithCinderVolumes-255478537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e56941d7-cac1-493f-a482-c251aba35879 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e56941d7-cac1-493f-a482-c251aba35879 tempest-TestInstancesWithCinderVolumes-255478537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:48 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:16:48 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:48 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e" returned: 0 in 0.547s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:48 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e Sep 23 15:16:48 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:48 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e56941d7-cac1-493f-a482-c251aba35879 tempest-TestInstancesWithCinderVolumes-255478537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.455s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:48 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-e56941d7-cac1-493f-a482-c251aba35879 tempest-TestInstancesWithCinderVolumes-255478537 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:16:49 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-e56941d7-cac1-493f-a482-c251aba35879 tempest-TestInstancesWithCinderVolumes-255478537 None] Deleted volume successfully. Sep 23 15:16:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e56941d7-cac1-493f-a482-c251aba35879 tempest-TestInstancesWithCinderVolumes-255478537 None] Lock "cinder-26787467-14fb-4099-88ff-5d72fc3ec25e-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63.d90381c4-fbd1-4003-872d-0bad11e0771e" returned: 0 in 0.478s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:49 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-quobyte-d90381c4-fbd1-4003-872d-0bad11e0771e" released by "_delete_snapshot" :: held 2.689s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-quobyte-459ffa9a-d8c9-435f-927b-b0a8f6727b63" released by "delete_snapshot" :: held 2.732s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:49 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Created reservations ['a338b558-b2e9-472e-bf61-09e23fe6cb95', '2d3074c5-73aa-46e8-8b06-d53c59a06df2', 'f374906c-8390-4483-a3c5-a109ad54231e', '1a5dee3f-460f-4627-979d-d01670b5eeb8'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:16:49 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Delete snapshot completed successfully. Sep 23 15:16:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-d90381c4-fbd1-4003-872d-0bad11e0771e-delete_snapshot" released by "delete_snapshot" :: held 3.007s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Snapshots deleted, issuing volume delete {{(pid=86064) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 23 15:16:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "cinder-quobyte-459ffa9a-d8c9-435f-927b-b0a8f6727b63" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-quobyte-459ffa9a-d8c9-435f-927b-b0a8f6727b63" acquired by "delete_volume" :: waited 0.029s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:49 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[be52422e-d7dd-4605-8b80-21ebeb90bc11]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:49 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 Sep 23 15:16:49 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:50 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63" returned: 0 in 0.581s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:50 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63 Sep 23 15:16:50 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:50 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-459ffa9a-d8c9-435f-927b-b0a8f6727b63" returned: 0 in 0.408s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:50 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-quobyte-459ffa9a-d8c9-435f-927b-b0a8f6727b63" released by "delete_volume" :: held 1.104s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:50 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Created reservations ['e92c9a09-233b-4ff4-ac4c-1d57122ad080', '90efd28a-5240-4c60-8e4b-60816df7c8ba', '32102010-c2cc-490f-afd5-bb7ba9d6b2b0', 'b9604091-d311-44e0-8d8c-99f9816b77be'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:16:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:50 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:51 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:16:51 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:51 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.373s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:51 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:16:51 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Deleted volume successfully. Sep 23 15:16:51 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-37ac8e38-e9e7-49b4-bae0-374bf13ec296 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-459ffa9a-d8c9-435f-927b-b0a8f6727b63-delete_volume" released by "delete_volume" :: held 9.913s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Flow 'volume_create_manager' (5ae4c1a3-4f25-48bf-977a-55d583e6fa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1866770-b6f2-4dba-9388-7215427ace59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1866770-b6f2-4dba-9388-7215427ace59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2067518820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=416487ef-21e9-4e77-add7-c9a1d5834b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5c4c91db1174dff966f5a72491f60c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:16:53Z,use_quota=True,user_id='f68130b416b3439cb597efbd818074ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (805076d4-0774-4134-a594-57ff484cf3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (805076d4-0774-4134-a594-57ff484cf3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d593c334-900b-40fc-8a94-7b0ba1855858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d593c334-900b-40fc-8a94-7b0ba1855858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '416487ef-21e9-4e77-add7-c9a1d5834b3a', 'volume_name': 'volume-416487ef-21e9-4e77-add7-c9a1d5834b3a', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b56a15-a01e-4293-9973-cac942c0359e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b56a15-a01e-4293-9973-cac942c0359e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (216f8e6b-792d-43f8-bb51-8a3fd650db21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:53 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Volume 416487ef-21e9-4e77-add7-c9a1d5834b3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-416487ef-21e9-4e77-add7-c9a1d5834b3a', 'volume_size': 1} Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2067518820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=416487ef-21e9-4e77-add7-c9a1d5834b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5c4c91db1174dff966f5a72491f60c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:16:53Z,use_quota=True,user_id='f68130b416b3439cb597efbd818074ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Creating volume 416487ef-21e9-4e77-add7-c9a1d5834b3a {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:16:53 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:53 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a 1073741824 Sep 23 15:16:53 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:53 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a 1073741824" returned: 0 in 0.595s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:53 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a Sep 23 15:16:53 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:54 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a" returned: 0 in 0.316s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:16:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (216f8e6b-792d-43f8-bb51-8a3fd650db21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-416487ef-21e9-4e77-add7-c9a1d5834b3a', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (477f75c9-537b-4028-93da-39acee8a6bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:54 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Volume volume-416487ef-21e9-4e77-add7-c9a1d5834b3a (416487ef-21e9-4e77-add7-c9a1d5834b3a): created successfully Sep 23 15:16:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (477f75c9-537b-4028-93da-39acee8a6bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Flow 'volume_create_manager' (5ae4c1a3-4f25-48bf-977a-55d583e6fa40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:16:54 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-08918d4f-8c3b-4150-8701-5cf72eeb578b tempest-VolumesDeleteCascade-1624468918 None] Created volume successfully. Sep 23 15:16:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d54823cb-2b99-4eb0-8180-72b604c87b16 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d54823cb-2b99-4eb0-8180-72b604c87b16 tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-d54823cb-2b99-4eb0-8180-72b604c87b16 tempest-VolumesDeleteCascade-1624468918 None] Creating offline snapshot 0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b of volume 416487ef-21e9-4e77-add7-c9a1d5834b3a {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:16:55 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aecbf6b-fe93-4adc-993f-918fdf083d4f]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d54823cb-2b99-4eb0-8180-72b604c87b16 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:55 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a Sep 23 15:16:55 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:56 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d54823cb-2b99-4eb0-8180-72b604c87b16 tempest-VolumesDeleteCascade-1624468918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a" returned: 0 in 0.507s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d54823cb-2b99-4eb0-8180-72b604c87b16 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:56 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b 1G Sep 23 15:16:56 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:56 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d54823cb-2b99-4eb0-8180-72b604c87b16 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b 1G" returned: 0 in 0.589s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d54823cb-2b99-4eb0-8180-72b604c87b16 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-416487ef-21e9-4e77-add7-c9a1d5834b3a -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:56 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-416487ef-21e9-4e77-add7-c9a1d5834b3a -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b Sep 23 15:16:56 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:57 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d54823cb-2b99-4eb0-8180-72b604c87b16 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-416487ef-21e9-4e77-add7-c9a1d5834b3a -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b" returned: 0 in 0.430s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:57 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-d54823cb-2b99-4eb0-8180-72b604c87b16 tempest-VolumesDeleteCascade-1624468918 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b is being set with open permissions: ugo+rw Sep 23 15:16:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d54823cb-2b99-4eb0-8180-72b604c87b16 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:57 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b Sep 23 15:16:57 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:57 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d54823cb-2b99-4eb0-8180-72b604c87b16 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b" returned: 0 in 0.340s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d54823cb-2b99-4eb0-8180-72b604c87b16 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:57 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.info Sep 23 15:16:57 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:57 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d54823cb-2b99-4eb0-8180-72b604c87b16 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.info" returned: 0 in 0.273s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:57 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-d54823cb-2b99-4eb0-8180-72b604c87b16 tempest-VolumesDeleteCascade-1624468918 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.info is being set with open permissions: ugo+rw Sep 23 15:16:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d54823cb-2b99-4eb0-8180-72b604c87b16 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:57 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.info Sep 23 15:16:57 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:16:57 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Sep 23 15:16:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d54823cb-2b99-4eb0-8180-72b604c87b16 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.info" returned: 0 in 0.273s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:16:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d54823cb-2b99-4eb0-8180-72b604c87b16 tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.584s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:58 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-d54823cb-2b99-4eb0-8180-72b604c87b16 tempest-VolumesDeleteCascade-1624468918 None] Create snapshot completed successfully Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Flow 'volume_create_manager' (dad29d95-e278-4288-a48e-146ace3025e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa411268-ee27-47c2-bf32-aaf84cf592ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa411268-ee27-47c2-bf32-aaf84cf592ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-305369124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a017ab5c-9bdb-453c-ad0f-4608e2fcca2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5c4c91db1174dff966f5a72491f60c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:16:59Z,use_quota=True,user_id='f68130b416b3439cb597efbd818074ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a3041a-a165-4cb9-ab76-35b2953806ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a3041a-a165-4cb9-ab76-35b2953806ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da079941-79cd-4c0d-8e4b-ff1aa4b927ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da079941-79cd-4c0d-8e4b-ff1aa4b927ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a017ab5c-9bdb-453c-ad0f-4608e2fcca2f', 'volume_name': 'volume-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f', 'volume_size': 1, 'snapshot_id': '0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b'}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f17e58d-74d8-4416-a126-b7031ba752cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f17e58d-74d8-4416-a126-b7031ba752cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf154ce-8455-4724-b478-09cfd8e59fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:16:59 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Volume a017ab5c-9bdb-453c-ad0f-4608e2fcca2f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f', 'volume_size': 1, 'snapshot_id': '0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b'} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "cinder-quobyte-0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f" by "_create_volume_from_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-quobyte-0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Creating volume a017ab5c-9bdb-453c-ad0f-4608e2fcca2f from snapshot 0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b {{(pid=86064) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "cinder-quobyte-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f" by "_copy_volume_from_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-quobyte-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] snapshot: 0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b, volume: a017ab5c-9bdb-453c-ad0f-4608e2fcca2f, {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[461fb2bb-a8a7-4dd6-99af-b3b7c09301bf]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:16:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:16:59 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b Sep 23 15:16:59 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:00 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b" returned: 0 in 0.421s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-416487ef-21e9-4e77-add7-c9a1d5834b3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:17:00 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[98699341-dc34-4425-b43c-1fc38553d405]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:17:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:00 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a Sep 23 15:17:00 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:00 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a" returned: 0 in 0.534s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 15:17:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Creating direct copy from snapshot {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 15:17:00 devstack cinder-volume[86064]: DEBUG cinder.utils [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Path /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f not found in is_blk_device check {{(pid=86064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 15:17:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:00 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f Sep 23 15:17:00 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:06 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=131,cinder:INSERT=33,cinder:UPDATE=155,cinder:DELETE=16 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:17:06 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-e575d815-29f1-437a-811d-95ec1d008b5c tempest-GroupsTest-1071163514 None] Group tempest-Group1-33748: creating Sep 23 15:17:06 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=129,cinder:INSERT=44,cinder:UPDATE=163,cinder:DELETE=10 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:17:06 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-e575d815-29f1-437a-811d-95ec1d008b5c tempest-GroupsTest-1071163514 None] Group tempest-Group1-33748: created successfully Sep 23 15:17:06 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-e575d815-29f1-437a-811d-95ec1d008b5c tempest-GroupsTest-1071163514 None] Create group completed successfully. Sep 23 15:17:07 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-0673676a-b246-4388-8840-aa78868b7377 tempest-GroupsTest-1071163514 None] Group tempest-Group2-1551169702: creating Sep 23 15:17:07 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-0673676a-b246-4388-8840-aa78868b7377 tempest-GroupsTest-1071163514 None] Group tempest-Group2-1551169702: created successfully Sep 23 15:17:07 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-0673676a-b246-4388-8840-aa78868b7377 tempest-GroupsTest-1071163514 None] Create group completed successfully. Sep 23 15:17:10 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:17:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Flow 'volume_create_manager' (6a8dcd62-ec9b-485a-a341-8a06965b3cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:17:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f69bb9d-ac31-457a-bb7f-27177f3caa52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f69bb9d-ac31-457a-bb7f-27177f3caa52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-348588825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b8559677-d0dc-42f0-b483-870497d0cd4c,host='devstack@QuobyteHD#QuobyteHD',id=20e86de2-6966-407d-93b3-4527f5afff82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff0b0417dfd43f8afd9807aed994094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:17:10Z,use_quota=True,user_id='b3b1ce87d79a4f25b34cf31e6bbb3914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e3dcb5d-978c-4639-b96c-129daa6ea0b1),volume_type_id=5e3dcb5d-978c-4639-b96c-129daa6ea0b1)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74029f70-e916-4f37-ab33-9b8e4b8401bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74029f70-e916-4f37-ab33-9b8e4b8401bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3445639-134b-4f9d-a0b3-42a4622cef50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3445639-134b-4f9d-a0b3-42a4622cef50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20e86de2-6966-407d-93b3-4527f5afff82', 'volume_name': 'volume-20e86de2-6966-407d-93b3-4527f5afff82', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e5af9f-2063-4eff-9a9d-d083600b25b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e5af9f-2063-4eff-9a9d-d083600b25b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afb1f35-c883-4128-af56-680fb79d0756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:10 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Volume 20e86de2-6966-407d-93b3-4527f5afff82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20e86de2-6966-407d-93b3-4527f5afff82', 'volume_size': 1} Sep 23 15:17:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:17:10 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f" returned: 0 in 10.134s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:10 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a, size 1024.00 MB, duration 10.14 sec, destination /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:17:10 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Converted 1024.00 MB image at 101.01 MB/s Sep 23 15:17:10 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f is being set with open permissions: ugo+rw Sep 23 15:17:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:10 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f Sep 23 15:17:10 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:11 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f" returned: 0 in 0.355s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:11 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-quobyte-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f" released by "_copy_volume_from_snapshot" :: held 11.602s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:17:11 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-quobyte-0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f" released by "_create_volume_from_snapshot" :: held 11.716s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:17:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.733s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:17:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.786s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:17:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b8559677-d0dc-42f0-b483-870497d0cd4c,created_at=2026-09-23T13:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-348588825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b8559677-d0dc-42f0-b483-870497d0cd4c,host='devstack@QuobyteHD#QuobyteHD',id=20e86de2-6966-407d-93b3-4527f5afff82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff0b0417dfd43f8afd9807aed994094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:17:10Z,use_quota=True,user_id='b3b1ce87d79a4f25b34cf31e6bbb3914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e3dcb5d-978c-4639-b96c-129daa6ea0b1),volume_type_id=5e3dcb5d-978c-4639-b96c-129daa6ea0b1)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:17:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Creating volume 20e86de2-6966-407d-93b3-4527f5afff82 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:17:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:17:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:17:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:17:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:17:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:17:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:17:11 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:17:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-20e86de2-6966-407d-93b3-4527f5afff82 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf154ce-8455-4724-b478-09cfd8e59fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f', 'volume_size': 1, 'snapshot_id': '0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b'}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3bd2885-b87d-48be-919d-b26003399915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:11 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-20e86de2-6966-407d-93b3-4527f5afff82 1073741824 Sep 23 15:17:11 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:11 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Volume volume-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f (a017ab5c-9bdb-453c-ad0f-4608e2fcca2f): created successfully Sep 23 15:17:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3bd2885-b87d-48be-919d-b26003399915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Flow 'volume_create_manager' (dad29d95-e278-4288-a48e-146ace3025e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:17:11 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-6d1b53a8-6325-4cbf-bb05-3f2fa73b4091 tempest-VolumesDeleteCascade-1624468918 None] Created volume successfully. Sep 23 15:17:11 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-20e86de2-6966-407d-93b3-4527f5afff82 1073741824" returned: 0 in 0.787s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "cinder-416487ef-21e9-4e77-add7-c9a1d5834b3a-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-416487ef-21e9-4e77-add7-c9a1d5834b3a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-20e86de2-6966-407d-93b3-4527f5afff82 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:12 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-20e86de2-6966-407d-93b3-4527f5afff82 Sep 23 15:17:12 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Performing cascade delete. {{(pid=86064) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "cinder-0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "cinder-quobyte-416487ef-21e9-4e77-add7-c9a1d5834b3a" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-quobyte-416487ef-21e9-4e77-add7-c9a1d5834b3a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "cinder-quobyte-0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-quobyte-0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Deleting offline snapshot 0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b of volume 416487ef-21e9-4e77-add7-c9a1d5834b3a {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] snapshot_file for this snap is: volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[1952f819-254a-43b4-96b5-a0e41f79c1de]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:12 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-20e86de2-6966-407d-93b3-4527f5afff82" returned: 0 in 0.307s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afb1f35-c883-4128-af56-680fb79d0756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20e86de2-6966-407d-93b3-4527f5afff82', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:12 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b Sep 23 15:17:12 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b52ac178-4286-4d72-a034-832bfe6288ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:12 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Volume volume-20e86de2-6966-407d-93b3-4527f5afff82 (20e86de2-6966-407d-93b3-4527f5afff82): created successfully Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b52ac178-4286-4d72-a034-832bfe6288ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Flow 'volume_create_manager' (6a8dcd62-ec9b-485a-a341-8a06965b3cf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:17:12 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7d2ed31b-6b17-4f46-967b-3b895be9a9e7 tempest-GroupsTest-1071163514 None] Created volume successfully. Sep 23 15:17:12 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b" returned: 0 in 0.489s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-416487ef-21e9-4e77-add7-c9a1d5834b3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b14de7-a8e9-4719-9935-31d8a23fb06e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:17:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:12 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a Sep 23 15:17:12 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:13 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a" returned: 0 in 0.732s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:13 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b Sep 23 15:17:13 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9df6394e-a05d-4c81-8d6c-1c69a5ba8506 tempest-GroupsTest-1071163514 None] Acquiring lock "cinder-quobyte-20e86de2-6966-407d-93b3-4527f5afff82" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:17:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9df6394e-a05d-4c81-8d6c-1c69a5ba8506 tempest-GroupsTest-1071163514 None] Lock "cinder-quobyte-20e86de2-6966-407d-93b3-4527f5afff82" acquired by "delete_volume" :: waited 0.032s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:17:13 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b069bbdc-8d6c-4745-b4e0-88095977932c]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:17:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9df6394e-a05d-4c81-8d6c-1c69a5ba8506 tempest-GroupsTest-1071163514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-20e86de2-6966-407d-93b3-4527f5afff82 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:13 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-20e86de2-6966-407d-93b3-4527f5afff82 Sep 23 15:17:13 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:14 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b" returned: 0 in 0.655s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:14 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b Sep 23 15:17:14 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:14 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9df6394e-a05d-4c81-8d6c-1c69a5ba8506 tempest-GroupsTest-1071163514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-20e86de2-6966-407d-93b3-4527f5afff82" returned: 0 in 0.554s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9df6394e-a05d-4c81-8d6c-1c69a5ba8506 tempest-GroupsTest-1071163514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-20e86de2-6966-407d-93b3-4527f5afff82 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:14 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-20e86de2-6966-407d-93b3-4527f5afff82 Sep 23 15:17:14 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:14 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9df6394e-a05d-4c81-8d6c-1c69a5ba8506 tempest-GroupsTest-1071163514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-20e86de2-6966-407d-93b3-4527f5afff82" returned: 0 in 0.304s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:14 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a.0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b" returned: 0 in 0.388s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9df6394e-a05d-4c81-8d6c-1c69a5ba8506 tempest-GroupsTest-1071163514 None] Lock "cinder-quobyte-20e86de2-6966-407d-93b3-4527f5afff82" released by "delete_volume" :: held 0.978s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:17:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-quobyte-0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b" released by "_delete_snapshot" :: held 2.426s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:17:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-quobyte-416487ef-21e9-4e77-add7-c9a1d5834b3a" released by "delete_snapshot" :: held 2.473s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:17:14 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-9df6394e-a05d-4c81-8d6c-1c69a5ba8506 tempest-GroupsTest-1071163514 None] Created reservations ['deb924a9-1d28-4fb7-ad35-7818523e6f3a'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:17:14 devstack cinder-volume[86064]: WARNING cinder.quota [None req-9df6394e-a05d-4c81-8d6c-1c69a5ba8506 tempest-GroupsTest-1071163514 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-828956667 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-828956667, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:17:14 devstack cinder-volume[86064]: WARNING cinder.quota [None req-9df6394e-a05d-4c81-8d6c-1c69a5ba8506 tempest-GroupsTest-1071163514 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-828956667 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-828956667, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:17:14 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Created reservations ['6ca50e03-b836-4701-a458-a1e57f39a132', '4762d931-94a2-4205-8133-f313d6cb92ff', 'c5c5dbfd-8260-435a-bb2d-7ac685e2a8d0', '0efa9447-68d5-4077-b3a8-02720b32551c'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:17:14 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-9df6394e-a05d-4c81-8d6c-1c69a5ba8506 tempest-GroupsTest-1071163514 None] Created reservations ['41e7f65d-cda2-4994-bba9-cfe47ba1c00c', '8f209f7c-d0b6-4812-a7e8-75b4043a2a69', '8e388bab-9fa1-4539-826e-69a03a3b2b46', '62e09443-1de2-4d5b-977c-45ca2b1db039'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:17:14 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Delete snapshot completed successfully. Sep 23 15:17:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-0a8afe65-ef0b-43a6-a7d6-c2a65c41ab2b-delete_snapshot" released by "delete_snapshot" :: held 2.802s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:17:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Snapshots deleted, issuing volume delete {{(pid=86064) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 23 15:17:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "cinder-quobyte-416487ef-21e9-4e77-add7-c9a1d5834b3a" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:17:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-quobyte-416487ef-21e9-4e77-add7-c9a1d5834b3a" acquired by "delete_volume" :: waited 0.028s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:17:15 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[031c7eb5-2103-4f8e-ac6f-b101cdf02d3b]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:17:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9df6394e-a05d-4c81-8d6c-1c69a5ba8506 tempest-GroupsTest-1071163514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:17:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9df6394e-a05d-4c81-8d6c-1c69a5ba8506 tempest-GroupsTest-1071163514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:17:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9df6394e-a05d-4c81-8d6c-1c69a5ba8506 tempest-GroupsTest-1071163514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:17:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9df6394e-a05d-4c81-8d6c-1c69a5ba8506 tempest-GroupsTest-1071163514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:17:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9df6394e-a05d-4c81-8d6c-1c69a5ba8506 tempest-GroupsTest-1071163514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:17:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9df6394e-a05d-4c81-8d6c-1c69a5ba8506 tempest-GroupsTest-1071163514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:15 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:17:15 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:15 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a Sep 23 15:17:15 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:15 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9df6394e-a05d-4c81-8d6c-1c69a5ba8506 tempest-GroupsTest-1071163514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.375s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:15 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-9df6394e-a05d-4c81-8d6c-1c69a5ba8506 tempest-GroupsTest-1071163514 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:17:15 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-9df6394e-a05d-4c81-8d6c-1c69a5ba8506 tempest-GroupsTest-1071163514 None] Delete group completed successfully. Sep 23 15:17:15 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a" returned: 0 in 0.603s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:15 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a Sep 23 15:17:15 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:15 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:17:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Flow 'volume_create_manager' (e4f0d191-6d6c-45e5-8e15-234488eb2683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:17:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca988ef5-0ac5-416b-9821-df11da1658d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca988ef5-0ac5-416b-9821-df11da1658d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1249612131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a7bfba-448d-489b-abeb-d0dd97968257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2827783ac13f4d5dafd0006ae873ca77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:17:16Z,use_quota=True,user_id='56028a4a986d476399fc8cd63f56c311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf662562-618a-4862-bad9-79219cec354f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf662562-618a-4862-bad9-79219cec354f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3adde64-df7f-4513-9f62-4a0ae4ea28c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:15 devstack cinder-volume[86064]: DEBUG cinder.image.glance [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Creating Keystone auth plugin from conf {{(pid=86064) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 15:17:15 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-416487ef-21e9-4e77-add7-c9a1d5834b3a" returned: 0 in 0.294s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-quobyte-416487ef-21e9-4e77-add7-c9a1d5834b3a" released by "delete_volume" :: held 1.009s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Created reservations ['79b8f3bf-2153-4043-ad19-57a7e59c667b', '75b9e942-5e9f-4422-b0df-70b82d4c8480', '803d1bf8-447a-4e50-b5ba-4bbecf80099f', '9ee14560-a118-40e3-9321-21e0526fba66'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:16 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:17:16 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-d70c75c3-6cc0-41bf-a701-0f68aa9cc599 tempest-GroupsTest-1071163514 None] Created reservations ['31ba7ac5-09f6-4f4c-ae93-9962a0bde556'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d70c75c3-6cc0-41bf-a701-0f68aa9cc599 tempest-GroupsTest-1071163514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d70c75c3-6cc0-41bf-a701-0f68aa9cc599 tempest-GroupsTest-1071163514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d70c75c3-6cc0-41bf-a701-0f68aa9cc599 tempest-GroupsTest-1071163514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d70c75c3-6cc0-41bf-a701-0f68aa9cc599 tempest-GroupsTest-1071163514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d70c75c3-6cc0-41bf-a701-0f68aa9cc599 tempest-GroupsTest-1071163514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d70c75c3-6cc0-41bf-a701-0f68aa9cc599 tempest-GroupsTest-1071163514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:16 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:17:16 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3adde64-df7f-4513-9f62-4a0ae4ea28c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '40a7bfba-448d-489b-abeb-d0dd97968257', 'volume_name': 'volume-40a7bfba-448d-489b-abeb-d0dd97968257', 'volume_size': 1, 'image_id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6096e44b8882450f8963b9e995032e95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'created_at': datetime.datetime(2026, 9, 23, 13, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e612db8e-4d33-469a-9b98-e7920f09b036/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3a80b6-f58c-4789-9e44-a276afd4cfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3a80b6-f58c-4789-9e44-a276afd4cfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ad0090-2beb-448b-aeae-102a2cb32e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:16 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Volume 40a7bfba-448d-489b-abeb-d0dd97968257: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-40a7bfba-448d-489b-abeb-d0dd97968257', 'volume_size': 1, 'image_id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6096e44b8882450f8963b9e995032e95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'created_at': datetime.datetime(2026, 9, 23, 13, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e612db8e-4d33-469a-9b98-e7920f09b036/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Trying to clone 40a7bfba-448d-489b-abeb-d0dd97968257 from image e612db8e-4d33-469a-9b98-e7920f09b036 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}]). {{(pid=86064) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 15:17:16 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.413s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:17:16 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Deleted volume successfully. Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c2e01077-7c24-409d-9c30-5c90fc2378c9 tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-416487ef-21e9-4e77-add7-c9a1d5834b3a-delete_volume" released by "delete_volume" :: held 4.638s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c5a07390-6ea7-48b9-95cc-09a9f1fd04dd tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "cinder-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c5a07390-6ea7-48b9-95cc-09a9f1fd04dd tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c5a07390-6ea7-48b9-95cc-09a9f1fd04dd tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "cinder-quobyte-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:17:16 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d70c75c3-6cc0-41bf-a701-0f68aa9cc599 tempest-GroupsTest-1071163514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.460s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-d70c75c3-6cc0-41bf-a701-0f68aa9cc599 tempest-GroupsTest-1071163514 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c5a07390-6ea7-48b9-95cc-09a9f1fd04dd tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-quobyte-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f" acquired by "delete_volume" :: waited 0.028s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:17:16 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-d70c75c3-6cc0-41bf-a701-0f68aa9cc599 tempest-GroupsTest-1071163514 None] Delete group completed successfully. Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9311f655-9351-487d-a0a5-24cafa242818]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:17:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c5a07390-6ea7-48b9-95cc-09a9f1fd04dd tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:17 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_tw5sdb5zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 15:17:17 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Image download 20.69 MB at 20.69 MB/s Sep 23 15:17:17 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f Sep 23 15:17:17 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:17 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d6918c-e972-4276-84e0-7c447ec80327]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:17:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_tw5sdb5zdevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:17 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_tw5sdb5zdevstack@QuobyteHD Sep 23 15:17:17 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:17 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c5a07390-6ea7-48b9-95cc-09a9f1fd04dd tempest-VolumesDeleteCascade-1624468918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f" returned: 0 in 0.532s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c5a07390-6ea7-48b9-95cc-09a9f1fd04dd tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:17 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f Sep 23 15:17:17 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:17 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_tw5sdb5zdevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:17 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Temporary image e612db8e-4d33-469a-9b98-e7920f09b036 is fetched for user 56028a4a986d476399fc8cd63f56c311. {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 15:17:17 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0442869-c87d-4d71-afe1-810eab67377f]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:17:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_tw5sdb5zdevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:17 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c5a07390-6ea7-48b9-95cc-09a9f1fd04dd tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f" returned: 0 in 0.366s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c5a07390-6ea7-48b9-95cc-09a9f1fd04dd tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-quobyte-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f" released by "delete_volume" :: held 0.964s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:17:17 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_tw5sdb5zdevstack@QuobyteHD Sep 23 15:17:17 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-c5a07390-6ea7-48b9-95cc-09a9f1fd04dd tempest-VolumesDeleteCascade-1624468918 None] Created reservations ['fd4c133a-5be1-4a55-b3bb-cc637a77a2d0', '35c46eb8-3177-4c4b-894a-2ec17aa84529', 'f164574d-b1c5-4b15-b45d-4b108b76918c', 'a4e4fbbb-c9b7-45d7-b444-44eb73777aee'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c5a07390-6ea7-48b9-95cc-09a9f1fd04dd tempest-VolumesDeleteCascade-1624468918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c5a07390-6ea7-48b9-95cc-09a9f1fd04dd tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c5a07390-6ea7-48b9-95cc-09a9f1fd04dd tempest-VolumesDeleteCascade-1624468918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c5a07390-6ea7-48b9-95cc-09a9f1fd04dd tempest-VolumesDeleteCascade-1624468918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c5a07390-6ea7-48b9-95cc-09a9f1fd04dd tempest-VolumesDeleteCascade-1624468918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c5a07390-6ea7-48b9-95cc-09a9f1fd04dd tempest-VolumesDeleteCascade-1624468918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:18 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:17:18 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:18 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f747da7f-3b4f-4cb4-80cc-c4539be7511f tempest-GroupsTest-1071163514 None] Group tempest-GroupsTest-Group-504590926: creating Sep 23 15:17:18 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f747da7f-3b4f-4cb4-80cc-c4539be7511f tempest-GroupsTest-1071163514 None] Group tempest-GroupsTest-Group-504590926: created successfully Sep 23 15:17:18 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f747da7f-3b4f-4cb4-80cc-c4539be7511f tempest-GroupsTest-1071163514 None] Create group completed successfully. Sep 23 15:17:18 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_tw5sdb5zdevstack@QuobyteHD" returned: 0 in 0.568s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1249612131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a7bfba-448d-489b-abeb-d0dd97968257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2827783ac13f4d5dafd0006ae873ca77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:17:16Z,use_quota=True,user_id='56028a4a986d476399fc8cd63f56c311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Creating volume 40a7bfba-448d-489b-abeb-d0dd97968257 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:17:18 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40a7bfba-448d-489b-abeb-d0dd97968257 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:18 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40a7bfba-448d-489b-abeb-d0dd97968257 1073741824 Sep 23 15:17:18 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:18 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c5a07390-6ea7-48b9-95cc-09a9f1fd04dd tempest-VolumesDeleteCascade-1624468918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.407s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-c5a07390-6ea7-48b9-95cc-09a9f1fd04dd tempest-VolumesDeleteCascade-1624468918 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:17:18 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-c5a07390-6ea7-48b9-95cc-09a9f1fd04dd tempest-VolumesDeleteCascade-1624468918 None] Deleted volume successfully. Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c5a07390-6ea7-48b9-95cc-09a9f1fd04dd tempest-VolumesDeleteCascade-1624468918 None] Lock "cinder-a017ab5c-9bdb-453c-ad0f-4608e2fcca2f-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:17:18 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40a7bfba-448d-489b-abeb-d0dd97968257 1073741824" returned: 0 in 0.524s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40a7bfba-448d-489b-abeb-d0dd97968257 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:18 devstack sudo[98222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40a7bfba-448d-489b-abeb-d0dd97968257 Sep 23 15:17:18 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:19 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40a7bfba-448d-489b-abeb-d0dd97968257" returned: 0 in 0.316s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:17:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:17:19 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Attempting download of e612db8e-4d33-469a-9b98-e7920f09b036 ((None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}])) to volume 40a7bfba-448d-489b-abeb-d0dd97968257. {{(pid=86064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 15:17:19 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c523971a-c848-4aa0-9f86-a7c444c4756e]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:17:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_frfukx0i {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:19 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_frfukx0i Sep 23 15:17:19 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:19 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_frfukx0i" returned: 0 in 0.479s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_frfukx0i {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:20 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_frfukx0i Sep 23 15:17:20 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Flow 'volume_create_manager' (5b1ec899-3079-46d5-8d56-d1df6d19b21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60f456f-a6d7-4e56-a648-b51eb6be9aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60f456f-a6d7-4e56-a648-b51eb6be9aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1041590217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0913b94c-183e-4528-b05e-6d2d55ed94e6,host='devstack@QuobyteHD#QuobyteHD',id=2ffc75e1-730d-437b-b62f-c66f750679db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff0b0417dfd43f8afd9807aed994094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:17:20Z,use_quota=True,user_id='b3b1ce87d79a4f25b34cf31e6bbb3914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c14c3b2-4fa8-466b-8895-b8dc1915060b),volume_type_id=6c14c3b2-4fa8-466b-8895-b8dc1915060b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:20 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040b2533-5c4a-413e-80de-c1b55ceca2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040b2533-5c4a-413e-80de-c1b55ceca2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7e691e-de51-4c7c-ac31-a791698304ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7e691e-de51-4c7c-ac31-a791698304ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ffc75e1-730d-437b-b62f-c66f750679db', 'volume_name': 'volume-2ffc75e1-730d-437b-b62f-c66f750679db', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bbc8f9b-1985-4d82-a0b3-1b86f03d2c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bbc8f9b-1985-4d82-a0b3-1b86f03d2c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de5df7c4-754f-4f15-b3de-05e3805f8e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:20 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Volume 2ffc75e1-730d-437b-b62f-c66f750679db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ffc75e1-730d-437b-b62f-c66f750679db', 'volume_size': 1} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0913b94c-183e-4528-b05e-6d2d55ed94e6,created_at=2026-09-23T13:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1041590217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0913b94c-183e-4528-b05e-6d2d55ed94e6,host='devstack@QuobyteHD#QuobyteHD',id=2ffc75e1-730d-437b-b62f-c66f750679db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff0b0417dfd43f8afd9807aed994094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:17:20Z,use_quota=True,user_id='b3b1ce87d79a4f25b34cf31e6bbb3914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c14c3b2-4fa8-466b-8895-b8dc1915060b),volume_type_id=6c14c3b2-4fa8-466b-8895-b8dc1915060b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Creating volume 2ffc75e1-730d-437b-b62f-c66f750679db {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:17:20 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ffc75e1-730d-437b-b62f-c66f750679db 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_frfukx0i" returned: 1 in 0.485s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e612db8e-4d33-469a-9b98-e7920f09b036_frfukx0i' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c319f31-b10e-47ce-b0c7-40e922a58dc2]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_tw5sdb5zdevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:20 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ffc75e1-730d-437b-b62f-c66f750679db 1073741824 Sep 23 15:17:20 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:20 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_tw5sdb5zdevstack@QuobyteHD Sep 23 15:17:20 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:20 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_tw5sdb5zdevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] e612db8e-4d33-469a-9b98-e7920f09b036 was qcow2, converting to qcow2 {{(pid=86064) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_tw5sdb5zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40a7bfba-448d-489b-abeb-d0dd97968257 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:20 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_tw5sdb5zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40a7bfba-448d-489b-abeb-d0dd97968257 Sep 23 15:17:20 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:20 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ffc75e1-730d-437b-b62f-c66f750679db 1073741824" returned: 0 in 0.608s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ffc75e1-730d-437b-b62f-c66f750679db {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:21 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ffc75e1-730d-437b-b62f-c66f750679db Sep 23 15:17:21 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:21 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ffc75e1-730d-437b-b62f-c66f750679db" returned: 0 in 0.501s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:17:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:17:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de5df7c4-754f-4f15-b3de-05e3805f8e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ffc75e1-730d-437b-b62f-c66f750679db', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2631e8-c430-4b60-986a-49e9e42c01af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:21 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Volume volume-2ffc75e1-730d-437b-b62f-c66f750679db (2ffc75e1-730d-437b-b62f-c66f750679db): created successfully Sep 23 15:17:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2631e8-c430-4b60-986a-49e9e42c01af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Flow 'volume_create_manager' (5b1ec899-3079-46d5-8d56-d1df6d19b21a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:17:21 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-096d7b32-6b2a-46fc-9bfd-cec232176d4c tempest-GroupsTest-1071163514 None] Created volume successfully. Sep 23 15:17:23 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_tw5sdb5zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40a7bfba-448d-489b-abeb-d0dd97968257" returned: 0 in 2.995s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:23 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e612db8e-4d33-469a-9b98-e7920f09b036_tw5sdb5zdevstack@QuobyteHD, size 112.00 MB, duration 3.00 sec, destination /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40a7bfba-448d-489b-abeb-d0dd97968257 {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:17:23 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Converted 112.00 MB image at 37.36 MB/s Sep 23 15:17:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40a7bfba-448d-489b-abeb-d0dd97968257 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:23 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40a7bfba-448d-489b-abeb-d0dd97968257 1G Sep 23 15:17:23 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:23 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Flow 'volume_create_manager' (6170df78-b77e-4ef0-8d1c-14c0b089df39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60fdbfc-1aad-4365-9125-46c2c378c205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60fdbfc-1aad-4365-9125-46c2c378c205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-496656323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0913b94c-183e-4528-b05e-6d2d55ed94e6,host='devstack@QuobyteHD#QuobyteHD',id=c361c7b4-128d-49e8-b917-3b7958950b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff0b0417dfd43f8afd9807aed994094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:17:24Z,use_quota=True,user_id='b3b1ce87d79a4f25b34cf31e6bbb3914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c14c3b2-4fa8-466b-8895-b8dc1915060b),volume_type_id=6c14c3b2-4fa8-466b-8895-b8dc1915060b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c9a176-003a-4afd-904d-87ce779c9e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c9a176-003a-4afd-904d-87ce779c9e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b409f716-ece0-4533-b9d8-8b4e5cd95115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b409f716-ece0-4533-b9d8-8b4e5cd95115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c361c7b4-128d-49e8-b917-3b7958950b85', 'volume_name': 'volume-c361c7b4-128d-49e8-b917-3b7958950b85', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78370d20-b340-4e0a-b8f2-c7817fee959f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78370d20-b340-4e0a-b8f2-c7817fee959f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2155615e-2e4d-47ce-be4a-12330a5cb2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:24 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Volume c361c7b4-128d-49e8-b917-3b7958950b85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c361c7b4-128d-49e8-b917-3b7958950b85', 'volume_size': 1} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0913b94c-183e-4528-b05e-6d2d55ed94e6,created_at=2026-09-23T13:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-496656323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0913b94c-183e-4528-b05e-6d2d55ed94e6,host='devstack@QuobyteHD#QuobyteHD',id=c361c7b4-128d-49e8-b917-3b7958950b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff0b0417dfd43f8afd9807aed994094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:17:24Z,use_quota=True,user_id='b3b1ce87d79a4f25b34cf31e6bbb3914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c14c3b2-4fa8-466b-8895-b8dc1915060b),volume_type_id=6c14c3b2-4fa8-466b-8895-b8dc1915060b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Creating volume c361c7b4-128d-49e8-b917-3b7958950b85 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:17:24 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c361c7b4-128d-49e8-b917-3b7958950b85 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:24 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c361c7b4-128d-49e8-b917-3b7958950b85 1073741824 Sep 23 15:17:24 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:24 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40a7bfba-448d-489b-abeb-d0dd97968257 1G" returned: 0 in 0.552s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Downloaded image e612db8e-4d33-469a-9b98-e7920f09b036 ((None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}])) to volume 40a7bfba-448d-489b-abeb-d0dd97968257 successfully. {{(pid=86064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Temporary image e612db8e-4d33-469a-9b98-e7920f09b036 for user 56028a4a986d476399fc8cd63f56c311 is deleted. {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Marking volume 40a7bfba-448d-489b-abeb-d0dd97968257 as bootable. {{(pid=86064) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Copying metadata from image e612db8e-4d33-469a-9b98-e7920f09b036 to 40a7bfba-448d-489b-abeb-d0dd97968257. {{(pid=86064) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Creating volume glance metadata for volume 40a7bfba-448d-489b-abeb-d0dd97968257 backed by image e612db8e-4d33-469a-9b98-e7920f09b036 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86064) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ad0090-2beb-448b-aeae-102a2cb32e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40a7bfba-448d-489b-abeb-d0dd97968257', 'volume_size': 1, 'image_id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e612db8e-4d33-469a-9b98-e7920f09b036', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6096e44b8882450f8963b9e995032e95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e612db8e-4d33-469a-9b98-e7920f09b036', 'created_at': datetime.datetime(2026, 9, 23, 13, 1, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 1, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e612db8e-4d33-469a-9b98-e7920f09b036/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fcf3a63-0b33-484c-9262-34e450948f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:24 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Volume volume-40a7bfba-448d-489b-abeb-d0dd97968257 (40a7bfba-448d-489b-abeb-d0dd97968257): created successfully Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fcf3a63-0b33-484c-9262-34e450948f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Flow 'volume_create_manager' (e4f0d191-6d6c-45e5-8e15-234488eb2683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:17:24 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-bc44da8c-b3a4-41c2-a4b0-2075c52e1482 tempest-TestShelveInstance-1752068730 None] Created volume successfully. Sep 23 15:17:24 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c361c7b4-128d-49e8-b917-3b7958950b85 1073741824" returned: 0 in 0.780s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c361c7b4-128d-49e8-b917-3b7958950b85 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:24 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c361c7b4-128d-49e8-b917-3b7958950b85 Sep 23 15:17:24 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:25 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c361c7b4-128d-49e8-b917-3b7958950b85" returned: 0 in 0.380s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:17:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:17:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2155615e-2e4d-47ce-be4a-12330a5cb2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c361c7b4-128d-49e8-b917-3b7958950b85', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b38c75-9ea5-4753-afa2-2359dc474697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:25 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Volume volume-c361c7b4-128d-49e8-b917-3b7958950b85 (c361c7b4-128d-49e8-b917-3b7958950b85): created successfully Sep 23 15:17:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b38c75-9ea5-4753-afa2-2359dc474697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Flow 'volume_create_manager' (6170df78-b77e-4ef0-8d1c-14c0b089df39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:17:25 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-2aa9569c-92fc-4d38-b19b-b7df852e333c tempest-GroupsTest-1071163514 None] Created volume successfully. Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Flow 'volume_create_manager' (b8be72a2-82bd-4775-ae10-d9411249d28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737e26e9-5642-4533-a715-a0d7c693c153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737e26e9-5642-4533-a715-a0d7c693c153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-530324126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=077a4fa7-10e0-4a08-b68a-04a4c986386b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df272df39e1043c38b2f6b2519a73960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:17:26Z,use_quota=True,user_id='f5c3a5204d314a33b86f71ad16712690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354bb617-447c-4c25-80bc-bceb4d239c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354bb617-447c-4c25-80bc-bceb4d239c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34440017-e50c-4d95-9bb0-df4c8edaf809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34440017-e50c-4d95-9bb0-df4c8edaf809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '077a4fa7-10e0-4a08-b68a-04a4c986386b', 'volume_name': 'volume-077a4fa7-10e0-4a08-b68a-04a4c986386b', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820c99e1-8201-454e-9572-25f9e1a48a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820c99e1-8201-454e-9572-25f9e1a48a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af2b983f-91e1-45ff-a81f-a1b09beab832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:26 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Volume 077a4fa7-10e0-4a08-b68a-04a4c986386b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-077a4fa7-10e0-4a08-b68a-04a4c986386b', 'volume_size': 1} Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-530324126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=077a4fa7-10e0-4a08-b68a-04a4c986386b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df272df39e1043c38b2f6b2519a73960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:17:26Z,use_quota=True,user_id='f5c3a5204d314a33b86f71ad16712690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Creating volume 077a4fa7-10e0-4a08-b68a-04a4c986386b {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:17:26 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-077a4fa7-10e0-4a08-b68a-04a4c986386b 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:26 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-077a4fa7-10e0-4a08-b68a-04a4c986386b 1073741824 Sep 23 15:17:26 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:26 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5c05cfb4-e186-4d02-8167-b1c093012985 tempest-GroupsTest-1071163514 None] Update group completed successfully. Sep 23 15:17:26 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-077a4fa7-10e0-4a08-b68a-04a4c986386b 1073741824" returned: 0 in 0.614s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-077a4fa7-10e0-4a08-b68a-04a4c986386b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:27 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-077a4fa7-10e0-4a08-b68a-04a4c986386b Sep 23 15:17:27 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:27 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-077a4fa7-10e0-4a08-b68a-04a4c986386b" returned: 0 in 0.319s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:27 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:17:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:17:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af2b983f-91e1-45ff-a81f-a1b09beab832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-077a4fa7-10e0-4a08-b68a-04a4c986386b', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260e96b3-c985-46ad-bab9-de166c06346b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:27 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Volume volume-077a4fa7-10e0-4a08-b68a-04a4c986386b (077a4fa7-10e0-4a08-b68a-04a4c986386b): created successfully Sep 23 15:17:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260e96b3-c985-46ad-bab9-de166c06346b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Flow 'volume_create_manager' (b8be72a2-82bd-4775-ae10-d9411249d28c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:17:27 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-1e47eca0-ce6b-4e91-bcda-095499e18766 tempest-VolumesMetadataTest-1098358264 None] Created volume successfully. Sep 23 15:17:28 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7e1258f8-d468-4df8-8d41-026767fae71d tempest-GroupsTest-1071163514 None] Update group completed successfully. Sep 23 15:17:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1e018470-7992-40b6-9076-9c50edcd5e34 tempest-VolumesMetadataTest-1098358264 None] Acquiring lock "cinder-077a4fa7-10e0-4a08-b68a-04a4c986386b-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:17:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1e018470-7992-40b6-9076-9c50edcd5e34 tempest-VolumesMetadataTest-1098358264 None] Lock "cinder-077a4fa7-10e0-4a08-b68a-04a4c986386b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:17:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1e018470-7992-40b6-9076-9c50edcd5e34 tempest-VolumesMetadataTest-1098358264 None] Acquiring lock "cinder-quobyte-077a4fa7-10e0-4a08-b68a-04a4c986386b" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:17:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1e018470-7992-40b6-9076-9c50edcd5e34 tempest-VolumesMetadataTest-1098358264 None] Lock "cinder-quobyte-077a4fa7-10e0-4a08-b68a-04a4c986386b" acquired by "delete_volume" :: waited 0.024s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:17:29 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a89583b-b4f2-40a6-95c0-ab11fd3df65f]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:17:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1e018470-7992-40b6-9076-9c50edcd5e34 tempest-VolumesMetadataTest-1098358264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-077a4fa7-10e0-4a08-b68a-04a4c986386b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:29 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-077a4fa7-10e0-4a08-b68a-04a4c986386b Sep 23 15:17:29 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:30 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1e018470-7992-40b6-9076-9c50edcd5e34 tempest-VolumesMetadataTest-1098358264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-077a4fa7-10e0-4a08-b68a-04a4c986386b" returned: 0 in 0.481s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1e018470-7992-40b6-9076-9c50edcd5e34 tempest-VolumesMetadataTest-1098358264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-077a4fa7-10e0-4a08-b68a-04a4c986386b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:30 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-077a4fa7-10e0-4a08-b68a-04a4c986386b Sep 23 15:17:30 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Acquiring lock "cinder-quobyte-2ffc75e1-730d-437b-b62f-c66f750679db" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:17:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Lock "cinder-quobyte-2ffc75e1-730d-437b-b62f-c66f750679db" acquired by "delete_volume" :: waited 0.039s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:17:30 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c7ea9b-19cf-41dc-bdad-cca63bb03aa3]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:17:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ffc75e1-730d-437b-b62f-c66f750679db {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:30 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1e018470-7992-40b6-9076-9c50edcd5e34 tempest-VolumesMetadataTest-1098358264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-077a4fa7-10e0-4a08-b68a-04a4c986386b" returned: 0 in 0.390s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1e018470-7992-40b6-9076-9c50edcd5e34 tempest-VolumesMetadataTest-1098358264 None] Lock "cinder-quobyte-077a4fa7-10e0-4a08-b68a-04a4c986386b" released by "delete_volume" :: held 0.953s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:17:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-2ec7750d-805d-4116-ba7d-7641b9f53dde req-514228a8-05ee-44da-b45d-145076fffaba tempest-TestShelveInstance-1752068730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:17:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-2ec7750d-805d-4116-ba7d-7641b9f53dde req-514228a8-05ee-44da-b45d-145076fffaba tempest-TestShelveInstance-1752068730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:17:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-2ec7750d-805d-4116-ba7d-7641b9f53dde req-514228a8-05ee-44da-b45d-145076fffaba tempest-TestShelveInstance-1752068730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:17:30 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-1e018470-7992-40b6-9076-9c50edcd5e34 tempest-VolumesMetadataTest-1098358264 None] Created reservations ['3944212d-7871-4643-abc8-c00b2aa58ffc', '616933e8-002c-4b2c-a5a2-787cfd140d36', '3160d935-b7a6-4b66-bf79-00648339d1ae', '81bab337-e7ac-494b-a840-38f81d10d069'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:17:30 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-2ec7750d-805d-4116-ba7d-7641b9f53dde req-514228a8-05ee-44da-b45d-145076fffaba tempest-TestShelveInstance-1752068730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-40a7bfba-448d-489b-abeb-d0dd97968257', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5e94e3b-5e4f-40b6-9845-b925f98fe497', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:17:30 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ffc75e1-730d-437b-b62f-c66f750679db Sep 23 15:17:30 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:30 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-2ec7750d-805d-4116-ba7d-7641b9f53dde req-514228a8-05ee-44da-b45d-145076fffaba tempest-TestShelveInstance-1752068730 None] attachment_update completed successfully. Sep 23 15:17:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1e018470-7992-40b6-9076-9c50edcd5e34 tempest-VolumesMetadataTest-1098358264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:17:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1e018470-7992-40b6-9076-9c50edcd5e34 tempest-VolumesMetadataTest-1098358264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:17:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1e018470-7992-40b6-9076-9c50edcd5e34 tempest-VolumesMetadataTest-1098358264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:17:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1e018470-7992-40b6-9076-9c50edcd5e34 tempest-VolumesMetadataTest-1098358264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:17:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1e018470-7992-40b6-9076-9c50edcd5e34 tempest-VolumesMetadataTest-1098358264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:17:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1e018470-7992-40b6-9076-9c50edcd5e34 tempest-VolumesMetadataTest-1098358264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:30 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:17:30 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:31 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ffc75e1-730d-437b-b62f-c66f750679db" returned: 0 in 0.695s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ffc75e1-730d-437b-b62f-c66f750679db {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:31 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ffc75e1-730d-437b-b62f-c66f750679db Sep 23 15:17:31 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:31 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1e018470-7992-40b6-9076-9c50edcd5e34 tempest-VolumesMetadataTest-1098358264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.464s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:31 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-1e018470-7992-40b6-9076-9c50edcd5e34 tempest-VolumesMetadataTest-1098358264 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:17:31 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-1e018470-7992-40b6-9076-9c50edcd5e34 tempest-VolumesMetadataTest-1098358264 None] Deleted volume successfully. Sep 23 15:17:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1e018470-7992-40b6-9076-9c50edcd5e34 tempest-VolumesMetadataTest-1098358264 None] Lock "cinder-077a4fa7-10e0-4a08-b68a-04a4c986386b-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:17:31 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2ffc75e1-730d-437b-b62f-c66f750679db" returned: 0 in 0.348s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Lock "cinder-quobyte-2ffc75e1-730d-437b-b62f-c66f750679db" released by "delete_volume" :: held 1.124s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:17:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Acquiring lock "cinder-quobyte-c361c7b4-128d-49e8-b917-3b7958950b85" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:17:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Lock "cinder-quobyte-c361c7b4-128d-49e8-b917-3b7958950b85" acquired by "delete_volume" :: waited 0.015s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:17:31 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c0b810-7b7c-4668-ba90-d6b85a5935dc]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:17:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c361c7b4-128d-49e8-b917-3b7958950b85 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:31 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c361c7b4-128d-49e8-b917-3b7958950b85 Sep 23 15:17:31 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:32 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c361c7b4-128d-49e8-b917-3b7958950b85" returned: 0 in 0.499s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c361c7b4-128d-49e8-b917-3b7958950b85 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:32 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c361c7b4-128d-49e8-b917-3b7958950b85 Sep 23 15:17:32 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:32 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c361c7b4-128d-49e8-b917-3b7958950b85" returned: 0 in 0.431s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Lock "cinder-quobyte-c361c7b4-128d-49e8-b917-3b7958950b85" released by "delete_volume" :: held 0.997s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:17:32 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Created reservations ['64c82788-f028-42f1-9686-fac9da7f9fe5'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:17:32 devstack cinder-volume[86064]: WARNING cinder.quota [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-728049351 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-728049351, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:17:32 devstack cinder-volume[86064]: WARNING cinder.quota [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-728049351 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-728049351, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:17:32 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Created reservations ['15eec969-9f2e-4644-84a2-e2beb7a00d82', '416c14f7-9246-4e30-857b-5d6ef3b3427a', '5ab99e6c-9263-48f3-9e43-ed69d13b0ebc', 'b18cd2ac-3dcf-4d09-9d90-4544112903cf'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:17:32 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Created reservations ['29853568-1686-4451-81c2-f183fd75e4e7', '1f03683f-e4ba-406c-b4af-879887c80a37', '407311c5-2717-42cb-aa6e-21051bdb4ed3', 'ae69a1d4-259c-41cf-ae6d-c67f8ceba63f'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:17:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:17:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:17:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:17:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:17:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:17:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:32 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:17:32 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:33 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.277s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:33 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:17:33 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-bc752358-8051-468d-a335-8d777a4511e1 tempest-GroupsTest-1071163514 None] Delete group completed successfully. Sep 23 15:17:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:17:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:17:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:17:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:17:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:17:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:17:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:36 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:17:36 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:36 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.372s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:17:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:17:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 28 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:17:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:17:42 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:UPDATE=88,cinder:SELECT=75,cinder:INSERT=27,cinder:DELETE=3 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:17:42 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=85,cinder:UPDATE=85,cinder:DELETE=6,cinder:INSERT=23 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:17:46 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-9f5c51e4-d4d7-4578-92c4-e69af66747ac tempest-GroupsV314Test-526893055 None] Group tempest-GroupsV314Test-Group-1843735238: creating Sep 23 15:17:46 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-9f5c51e4-d4d7-4578-92c4-e69af66747ac tempest-GroupsV314Test-526893055 None] Group tempest-GroupsV314Test-Group-1843735238: created successfully Sep 23 15:17:46 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-9f5c51e4-d4d7-4578-92c4-e69af66747ac tempest-GroupsV314Test-526893055 None] Create group completed successfully. Sep 23 15:17:48 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:17:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Flow 'volume_create_manager' (e14cc578-611d-4ae1-975d-8ba99e13edfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:17:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105f0bd5-0170-4e7c-bf03-2f2ce9cc7e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105f0bd5-0170-4e7c-bf03-2f2ce9cc7e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-63250581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dbad23d4-2973-49ac-86f9-1d9e88e5a2cf,host='devstack@QuobyteHD#QuobyteHD',id=7f2e1cae-ff7b-446e-818b-07417ae9221c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7408133cf340da9ca9514198a0b24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:17:48Z,use_quota=True,user_id='5c07ff43f3ee40f09553548620d45293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02fb5d7f-a1fb-41a4-97b3-f4d138d1ebb5),volume_type_id=02fb5d7f-a1fb-41a4-97b3-f4d138d1ebb5)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e844b73-3181-49e5-9fbf-fb0abf1fe962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e844b73-3181-49e5-9fbf-fb0abf1fe962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a335ddc-e1ae-4f90-adc3-970f18761a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a335ddc-e1ae-4f90-adc3-970f18761a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f2e1cae-ff7b-446e-818b-07417ae9221c', 'volume_name': 'volume-7f2e1cae-ff7b-446e-818b-07417ae9221c', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2be5edb-6d39-4a94-bb40-4a38fcf5a34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2be5edb-6d39-4a94-bb40-4a38fcf5a34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abad8f1-fa77-4dfa-a1f1-fde7a7989bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:48 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Volume 7f2e1cae-ff7b-446e-818b-07417ae9221c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f2e1cae-ff7b-446e-818b-07417ae9221c', 'volume_size': 1} Sep 23 15:17:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:17:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:17:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dbad23d4-2973-49ac-86f9-1d9e88e5a2cf,created_at=2026-09-23T13:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-63250581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dbad23d4-2973-49ac-86f9-1d9e88e5a2cf,host='devstack@QuobyteHD#QuobyteHD',id=7f2e1cae-ff7b-446e-818b-07417ae9221c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7408133cf340da9ca9514198a0b24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:17:48Z,use_quota=True,user_id='5c07ff43f3ee40f09553548620d45293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02fb5d7f-a1fb-41a4-97b3-f4d138d1ebb5),volume_type_id=02fb5d7f-a1fb-41a4-97b3-f4d138d1ebb5)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:17:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Creating volume 7f2e1cae-ff7b-446e-818b-07417ae9221c {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:17:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:17:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:17:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:17:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:17:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:17:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:17:48 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:17:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:48 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c 1073741824 Sep 23 15:17:48 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:49 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c 1073741824" returned: 0 in 0.658s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:49 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c Sep 23 15:17:49 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:49 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c" returned: 0 in 0.463s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:17:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:17:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abad8f1-fa77-4dfa-a1f1-fde7a7989bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f2e1cae-ff7b-446e-818b-07417ae9221c', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ab6c31-a507-48dc-ba68-266824ac19a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:17:49 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Volume volume-7f2e1cae-ff7b-446e-818b-07417ae9221c (7f2e1cae-ff7b-446e-818b-07417ae9221c): created successfully Sep 23 15:17:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ab6c31-a507-48dc-ba68-266824ac19a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:17:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Flow 'volume_create_manager' (e14cc578-611d-4ae1-975d-8ba99e13edfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:17:49 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-51a457bf-3132-4015-9461-7a27c9c1fb10 tempest-GroupsV314Test-526893055 None] Created volume successfully. Sep 23 15:17:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:17:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:17:52 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Cloning volume 7f2e1cae-ff7b-446e-818b-07417ae9221c to volume dffbbb33-7198-4a5b-8011-cc70ab36169e Sep 23 15:17:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Creating offline snapshot f841b119-f1da-485d-a0de-67c6a0fb0f4a of volume 7f2e1cae-ff7b-446e-818b-07417ae9221c {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:17:52 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[27081561-95d9-4d38-b503-b3e13d61b125]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:17:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:52 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c Sep 23 15:17:52 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:52 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c" returned: 0 in 0.596s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:52 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a 1G Sep 23 15:17:52 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:53 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a 1G" returned: 0 in 0.807s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f2e1cae-ff7b-446e-818b-07417ae9221c -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:53 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f2e1cae-ff7b-446e-818b-07417ae9221c -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a Sep 23 15:17:53 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:54 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f2e1cae-ff7b-446e-818b-07417ae9221c -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a" returned: 0 in 0.672s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:54 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a is being set with open permissions: ugo+rw: NotImplementedError Sep 23 15:17:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:54 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a Sep 23 15:17:54 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:54 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a" returned: 0 in 0.348s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:54 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.info Sep 23 15:17:54 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:55 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.info" returned: 0 in 0.755s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:55 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 15:17:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:55 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.info Sep 23 15:17:55 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:56 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.info" returned: 0 in 0.684s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Acquiring lock "cinder-quobyte-dffbbb33-7198-4a5b-8011-cc70ab36169e" by "_copy_volume_from_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:17:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Lock "cinder-quobyte-dffbbb33-7198-4a5b-8011-cc70ab36169e" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:17:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] snapshot: f841b119-f1da-485d-a0de-67c6a0fb0f4a, volume: dffbbb33-7198-4a5b-8011-cc70ab36169e, {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 15:17:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:17:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:17:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:17:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:17:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:17:56 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb313cf-0f8e-4864-ab41-afe4a423dab8]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:17:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:56 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a Sep 23 15:17:56 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:57 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a" returned: 0 in 1.468s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f2e1cae-ff7b-446e-818b-07417ae9221c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:17:57 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8685cd90-b7a2-4bc4-8632-ba1d447b6a10]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:17:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:57 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c Sep 23 15:17:57 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:17:58 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Sep 23 15:17:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c" returned: 0 in 0.602s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:17:58 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 15:17:58 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Creating direct copy from snapshot {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 15:17:58 devstack cinder-volume[86064]: DEBUG cinder.utils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Path /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-dffbbb33-7198-4a5b-8011-cc70ab36169e not found in is_blk_device check {{(pid=86064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 15:17:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-dffbbb33-7198-4a5b-8011-cc70ab36169e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:17:58 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-dffbbb33-7198-4a5b-8011-cc70ab36169e Sep 23 15:17:58 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:04 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:18:04 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6,cinder:INSERT=3 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:18:09 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-dffbbb33-7198-4a5b-8011-cc70ab36169e" returned: 0 in 11.032s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:09 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c, size 1024.00 MB, duration 11.03 sec, destination /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-dffbbb33-7198-4a5b-8011-cc70ab36169e {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:18:09 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Converted 1024.00 MB image at 92.81 MB/s Sep 23 15:18:09 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-dffbbb33-7198-4a5b-8011-cc70ab36169e is being set with open permissions: ugo+rw: NotImplementedError Sep 23 15:18:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-dffbbb33-7198-4a5b-8011-cc70ab36169e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:09 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-dffbbb33-7198-4a5b-8011-cc70ab36169e Sep 23 15:18:09 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:10 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-dffbbb33-7198-4a5b-8011-cc70ab36169e" returned: 0 in 0.611s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Lock "cinder-quobyte-dffbbb33-7198-4a5b-8011-cc70ab36169e" released by "_copy_volume_from_snapshot" :: held 13.885s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:18:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Acquiring lock "cinder-quobyte-f841b119-f1da-485d-a0de-67c6a0fb0f4a" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:18:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Lock "cinder-quobyte-f841b119-f1da-485d-a0de-67c6a0fb0f4a" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:18:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Deleting offline snapshot f841b119-f1da-485d-a0de-67c6a0fb0f4a of volume 7f2e1cae-ff7b-446e-818b-07417ae9221c {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:18:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] snapshot_file for this snap is: volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:18:10 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d255f47f-eb32-4711-baa3-f294a93df07d]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:18:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:10 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a Sep 23 15:18:10 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:10 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a" returned: 0 in 0.524s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f2e1cae-ff7b-446e-818b-07417ae9221c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:18:10 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa815217-dbbb-425a-855e-2aa941b802d2]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:18:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:10 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c Sep 23 15:18:10 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:11 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c" returned: 0 in 0.752s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:11 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a Sep 23 15:18:11 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:12 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a" returned: 0 in 0.571s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:12 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a Sep 23 15:18:12 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Flow 'volume_create_manager' (e8f59e11-82d7-481b-9dd1-e9bee6fd55ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eaa270b-9db6-4819-baa5-302dca44dfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eaa270b-9db6-4819-baa5-302dca44dfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-488367603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d545c13-28e9-425a-82db-2d153bd6db27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d31d4dba76634dcab253598f353b1dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:18:12Z,use_quota=True,user_id='43df1514de1e40438105f9227dd79daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32691585-6f13-4588-875e-08fad3ee0968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32691585-6f13-4588-875e-08fad3ee0968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fe3a5a-f0c8-4a9f-8ca8-23e0d9d8d087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fe3a5a-f0c8-4a9f-8ca8-23e0d9d8d087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d545c13-28e9-425a-82db-2d153bd6db27', 'volume_name': 'volume-9d545c13-28e9-425a-82db-2d153bd6db27', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252921d2-f683-42ec-a393-52cf60deb287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252921d2-f683-42ec-a393-52cf60deb287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1bd9da0-3832-4eca-ada4-b47df8e23619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:12 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Volume 9d545c13-28e9-425a-82db-2d153bd6db27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d545c13-28e9-425a-82db-2d153bd6db27', 'volume_size': 1} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:12 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c.f841b119-f1da-485d-a0de-67c6a0fb0f4a" returned: 0 in 0.320s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Lock "cinder-quobyte-f841b119-f1da-485d-a0de-67c6a0fb0f4a" released by "_delete_snapshot" :: held 2.320s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.442s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.095s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-488367603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d545c13-28e9-425a-82db-2d153bd6db27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d31d4dba76634dcab253598f353b1dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:18:12Z,use_quota=True,user_id='43df1514de1e40438105f9227dd79daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Creating volume 9d545c13-28e9-425a-82db-2d153bd6db27 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:18:12 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:12 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27 1073741824 Sep 23 15:18:12 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:12 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f1a17905-d2f7-4fa6-8c8a-520b032bc28a tempest-GroupsV314Test-526893055 None] Create group from source-group-dbad23d4-2973-49ac-86f9-1d9e88e5a2cf completed successfully. Sep 23 15:18:12 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27 1073741824" returned: 0 in 0.463s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:13 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27 Sep 23 15:18:13 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:13 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27" returned: 0 in 0.252s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:18:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1bd9da0-3832-4eca-ada4-b47df8e23619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d545c13-28e9-425a-82db-2d153bd6db27', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7475811c-5d23-45e3-a875-957b6c33afb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:13 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Volume volume-9d545c13-28e9-425a-82db-2d153bd6db27 (9d545c13-28e9-425a-82db-2d153bd6db27): created successfully Sep 23 15:18:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7475811c-5d23-45e3-a875-957b6c33afb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Flow 'volume_create_manager' (e8f59e11-82d7-481b-9dd1-e9bee6fd55ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:18:13 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-fb3c680e-f281-414e-a7b0-51e2089d7b93 tempest-VolumesSnapshotTestJSON-320297079 None] Created volume successfully. Sep 23 15:18:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5c05072e-01d2-46c9-9a00-aa0555f8a8bb tempest-GroupsV314Test-526893055 None] Acquiring lock "cinder-quobyte-dffbbb33-7198-4a5b-8011-cc70ab36169e" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:18:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5c05072e-01d2-46c9-9a00-aa0555f8a8bb tempest-GroupsV314Test-526893055 None] Lock "cinder-quobyte-dffbbb33-7198-4a5b-8011-cc70ab36169e" acquired by "delete_volume" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:18:14 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[180d7427-8cd8-4e59-a044-2e616e720be0]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:18:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5c05072e-01d2-46c9-9a00-aa0555f8a8bb tempest-GroupsV314Test-526893055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-dffbbb33-7198-4a5b-8011-cc70ab36169e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:14 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-dffbbb33-7198-4a5b-8011-cc70ab36169e Sep 23 15:18:14 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cccd8f47-7fdc-406c-87c1-0f09e2bef918 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cccd8f47-7fdc-406c-87c1-0f09e2bef918 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-cccd8f47-7fdc-406c-87c1-0f09e2bef918 tempest-VolumesSnapshotTestJSON-320297079 None] Creating offline snapshot b8447c3a-0655-4b7f-8b58-1c44b78a6b07 of volume 9d545c13-28e9-425a-82db-2d153bd6db27 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:18:14 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d14dc1-7e96-45b4-9df0-0e556f397a57]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:18:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cccd8f47-7fdc-406c-87c1-0f09e2bef918 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:14 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5c05072e-01d2-46c9-9a00-aa0555f8a8bb tempest-GroupsV314Test-526893055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-dffbbb33-7198-4a5b-8011-cc70ab36169e" returned: 0 in 0.423s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5c05072e-01d2-46c9-9a00-aa0555f8a8bb tempest-GroupsV314Test-526893055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-dffbbb33-7198-4a5b-8011-cc70ab36169e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:14 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-dffbbb33-7198-4a5b-8011-cc70ab36169e Sep 23 15:18:14 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:14 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27 Sep 23 15:18:14 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:14 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5c05072e-01d2-46c9-9a00-aa0555f8a8bb tempest-GroupsV314Test-526893055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-dffbbb33-7198-4a5b-8011-cc70ab36169e" returned: 0 in 0.261s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5c05072e-01d2-46c9-9a00-aa0555f8a8bb tempest-GroupsV314Test-526893055 None] Lock "cinder-quobyte-dffbbb33-7198-4a5b-8011-cc70ab36169e" released by "delete_volume" :: held 0.742s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:18:15 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-5c05072e-01d2-46c9-9a00-aa0555f8a8bb tempest-GroupsV314Test-526893055 None] Created reservations ['29faa8c0-1dde-4994-a702-93238b7308b5'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:18:15 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cccd8f47-7fdc-406c-87c1-0f09e2bef918 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27" returned: 0 in 0.392s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cccd8f47-7fdc-406c-87c1-0f09e2bef918 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.b8447c3a-0655-4b7f-8b58-1c44b78a6b07 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:15 devstack cinder-volume[86064]: WARNING cinder.quota [None req-5c05072e-01d2-46c9-9a00-aa0555f8a8bb tempest-GroupsV314Test-526893055 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-615090464 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-615090464, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:18:15 devstack cinder-volume[86064]: WARNING cinder.quota [None req-5c05072e-01d2-46c9-9a00-aa0555f8a8bb tempest-GroupsV314Test-526893055 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-615090464 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-615090464, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:18:15 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.b8447c3a-0655-4b7f-8b58-1c44b78a6b07 1G Sep 23 15:18:15 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:15 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-5c05072e-01d2-46c9-9a00-aa0555f8a8bb tempest-GroupsV314Test-526893055 None] Created reservations ['a8197d7f-f131-4913-9fda-e47d0e51dd96', '0f32b536-cbc9-4be1-a466-fbe4686c9955', '3598d0f6-91cc-40ce-8c38-91acf0b25bf4', 'a8486469-a397-4088-a898-e7b62e517a28'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:18:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5c05072e-01d2-46c9-9a00-aa0555f8a8bb tempest-GroupsV314Test-526893055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5c05072e-01d2-46c9-9a00-aa0555f8a8bb tempest-GroupsV314Test-526893055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5c05072e-01d2-46c9-9a00-aa0555f8a8bb tempest-GroupsV314Test-526893055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:18:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5c05072e-01d2-46c9-9a00-aa0555f8a8bb tempest-GroupsV314Test-526893055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:18:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5c05072e-01d2-46c9-9a00-aa0555f8a8bb tempest-GroupsV314Test-526893055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5c05072e-01d2-46c9-9a00-aa0555f8a8bb tempest-GroupsV314Test-526893055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:15 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:18:15 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:15 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5c05072e-01d2-46c9-9a00-aa0555f8a8bb tempest-GroupsV314Test-526893055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.326s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:15 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-5c05072e-01d2-46c9-9a00-aa0555f8a8bb tempest-GroupsV314Test-526893055 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:18:15 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:15 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5c05072e-01d2-46c9-9a00-aa0555f8a8bb tempest-GroupsV314Test-526893055 None] Delete group completed successfully. Sep 23 15:18:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cccd8f47-7fdc-406c-87c1-0f09e2bef918 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.b8447c3a-0655-4b7f-8b58-1c44b78a6b07 1G" returned: 0 in 0.510s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cccd8f47-7fdc-406c-87c1-0f09e2bef918 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d545c13-28e9-425a-82db-2d153bd6db27 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.b8447c3a-0655-4b7f-8b58-1c44b78a6b07 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:15 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d545c13-28e9-425a-82db-2d153bd6db27 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.b8447c3a-0655-4b7f-8b58-1c44b78a6b07 Sep 23 15:18:15 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c0336af6-11d2-422c-849d-23b0a47221cc tempest-GroupsV314Test-526893055 None] Acquiring lock "cinder-quobyte-7f2e1cae-ff7b-446e-818b-07417ae9221c" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:18:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c0336af6-11d2-422c-849d-23b0a47221cc tempest-GroupsV314Test-526893055 None] Lock "cinder-quobyte-7f2e1cae-ff7b-446e-818b-07417ae9221c" acquired by "delete_volume" :: waited 0.019s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:18:15 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ded0b4a-adb9-46ed-b08d-c5a96423b05d]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:18:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c0336af6-11d2-422c-849d-23b0a47221cc tempest-GroupsV314Test-526893055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:15 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cccd8f47-7fdc-406c-87c1-0f09e2bef918 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d545c13-28e9-425a-82db-2d153bd6db27 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.b8447c3a-0655-4b7f-8b58-1c44b78a6b07" returned: 0 in 0.378s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:15 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-cccd8f47-7fdc-406c-87c1-0f09e2bef918 tempest-VolumesSnapshotTestJSON-320297079 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.b8447c3a-0655-4b7f-8b58-1c44b78a6b07 is being set with open permissions: ugo+rw Sep 23 15:18:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cccd8f47-7fdc-406c-87c1-0f09e2bef918 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.b8447c3a-0655-4b7f-8b58-1c44b78a6b07 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:15 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c Sep 23 15:18:15 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.b8447c3a-0655-4b7f-8b58-1c44b78a6b07 Sep 23 15:18:15 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:15 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:16 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cccd8f47-7fdc-406c-87c1-0f09e2bef918 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.b8447c3a-0655-4b7f-8b58-1c44b78a6b07" returned: 0 in 0.303s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:16 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c0336af6-11d2-422c-849d-23b0a47221cc tempest-GroupsV314Test-526893055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c" returned: 0 in 0.436s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c0336af6-11d2-422c-849d-23b0a47221cc tempest-GroupsV314Test-526893055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:16 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c Sep 23 15:18:16 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cccd8f47-7fdc-406c-87c1-0f09e2bef918 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:16 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.info Sep 23 15:18:16 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:16 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c0336af6-11d2-422c-849d-23b0a47221cc tempest-GroupsV314Test-526893055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7f2e1cae-ff7b-446e-818b-07417ae9221c" returned: 0 in 0.263s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c0336af6-11d2-422c-849d-23b0a47221cc tempest-GroupsV314Test-526893055 None] Lock "cinder-quobyte-7f2e1cae-ff7b-446e-818b-07417ae9221c" released by "delete_volume" :: held 0.785s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:18:16 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cccd8f47-7fdc-406c-87c1-0f09e2bef918 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.info" returned: 0 in 0.290s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:16 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-cccd8f47-7fdc-406c-87c1-0f09e2bef918 tempest-VolumesSnapshotTestJSON-320297079 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.info is being set with open permissions: ugo+rw Sep 23 15:18:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cccd8f47-7fdc-406c-87c1-0f09e2bef918 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:16 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.info Sep 23 15:18:16 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:16 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-c0336af6-11d2-422c-849d-23b0a47221cc tempest-GroupsV314Test-526893055 None] Created reservations ['5584d672-7559-4c55-a9c2-215defbb580d'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:18:16 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-c0336af6-11d2-422c-849d-23b0a47221cc tempest-GroupsV314Test-526893055 None] Created reservations ['bf3e293e-399a-408b-9603-0f8553d14a4a', 'efb332db-f15a-49dc-994c-539a3ccf7a6f', '7dd93eb1-0455-4c2f-997f-9880175d77b7', '92187be0-b37b-48a8-af45-4e4ad739181d'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:18:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c0336af6-11d2-422c-849d-23b0a47221cc tempest-GroupsV314Test-526893055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c0336af6-11d2-422c-849d-23b0a47221cc tempest-GroupsV314Test-526893055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c0336af6-11d2-422c-849d-23b0a47221cc tempest-GroupsV314Test-526893055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:18:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c0336af6-11d2-422c-849d-23b0a47221cc tempest-GroupsV314Test-526893055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:18:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c0336af6-11d2-422c-849d-23b0a47221cc tempest-GroupsV314Test-526893055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c0336af6-11d2-422c-849d-23b0a47221cc tempest-GroupsV314Test-526893055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:16 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:18:16 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:16 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cccd8f47-7fdc-406c-87c1-0f09e2bef918 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.info" returned: 0 in 0.278s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cccd8f47-7fdc-406c-87c1-0f09e2bef918 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.272s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:16 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-cccd8f47-7fdc-406c-87c1-0f09e2bef918 tempest-VolumesSnapshotTestJSON-320297079 None] Create snapshot completed successfully Sep 23 15:18:17 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c0336af6-11d2-422c-849d-23b0a47221cc tempest-GroupsV314Test-526893055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.265s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:17 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-c0336af6-11d2-422c-849d-23b0a47221cc tempest-GroupsV314Test-526893055 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:18:17 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-c0336af6-11d2-422c-849d-23b0a47221cc tempest-GroupsV314Test-526893055 None] Delete group completed successfully. Sep 23 15:18:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a714edb3-19a1-4cea-b726-b84f734dc8df tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-b8447c3a-0655-4b7f-8b58-1c44b78a6b07-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:18:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a714edb3-19a1-4cea-b726-b84f734dc8df tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-b8447c3a-0655-4b7f-8b58-1c44b78a6b07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:18:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a714edb3-19a1-4cea-b726-b84f734dc8df tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-quobyte-9d545c13-28e9-425a-82db-2d153bd6db27" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:18:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a714edb3-19a1-4cea-b726-b84f734dc8df tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-9d545c13-28e9-425a-82db-2d153bd6db27" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:18:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a714edb3-19a1-4cea-b726-b84f734dc8df tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-quobyte-b8447c3a-0655-4b7f-8b58-1c44b78a6b07" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:18:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a714edb3-19a1-4cea-b726-b84f734dc8df tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-b8447c3a-0655-4b7f-8b58-1c44b78a6b07" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:18:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-a714edb3-19a1-4cea-b726-b84f734dc8df tempest-VolumesSnapshotTestJSON-320297079 None] Deleting offline snapshot b8447c3a-0655-4b7f-8b58-1c44b78a6b07 of volume 9d545c13-28e9-425a-82db-2d153bd6db27 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:18:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-a714edb3-19a1-4cea-b726-b84f734dc8df tempest-VolumesSnapshotTestJSON-320297079 None] snapshot_file for this snap is: volume-9d545c13-28e9-425a-82db-2d153bd6db27.b8447c3a-0655-4b7f-8b58-1c44b78a6b07 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:18:18 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f1c8ad-20d7-4412-9801-6db8b342d998]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:18:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a714edb3-19a1-4cea-b726-b84f734dc8df tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.b8447c3a-0655-4b7f-8b58-1c44b78a6b07 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:18 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.b8447c3a-0655-4b7f-8b58-1c44b78a6b07 Sep 23 15:18:18 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:18 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a714edb3-19a1-4cea-b726-b84f734dc8df tempest-VolumesSnapshotTestJSON-320297079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.b8447c3a-0655-4b7f-8b58-1c44b78a6b07" returned: 0 in 0.451s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-a714edb3-19a1-4cea-b726-b84f734dc8df tempest-VolumesSnapshotTestJSON-320297079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d545c13-28e9-425a-82db-2d153bd6db27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:18:18 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[625508bd-ccd1-433d-98e9-ece0a38154fa]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:18:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a714edb3-19a1-4cea-b726-b84f734dc8df tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:18 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27 Sep 23 15:18:18 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:19 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a714edb3-19a1-4cea-b726-b84f734dc8df tempest-VolumesSnapshotTestJSON-320297079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27" returned: 0 in 0.570s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a714edb3-19a1-4cea-b726-b84f734dc8df tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.b8447c3a-0655-4b7f-8b58-1c44b78a6b07 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:19 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.b8447c3a-0655-4b7f-8b58-1c44b78a6b07 Sep 23 15:18:19 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:19 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a714edb3-19a1-4cea-b726-b84f734dc8df tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.b8447c3a-0655-4b7f-8b58-1c44b78a6b07" returned: 0 in 0.508s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a714edb3-19a1-4cea-b726-b84f734dc8df tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.b8447c3a-0655-4b7f-8b58-1c44b78a6b07 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:19 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.b8447c3a-0655-4b7f-8b58-1c44b78a6b07 Sep 23 15:18:19 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:19 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a714edb3-19a1-4cea-b726-b84f734dc8df tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27.b8447c3a-0655-4b7f-8b58-1c44b78a6b07" returned: 0 in 0.316s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a714edb3-19a1-4cea-b726-b84f734dc8df tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-b8447c3a-0655-4b7f-8b58-1c44b78a6b07" released by "_delete_snapshot" :: held 1.984s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:18:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a714edb3-19a1-4cea-b726-b84f734dc8df tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-9d545c13-28e9-425a-82db-2d153bd6db27" released by "delete_snapshot" :: held 2.012s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:18:20 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-a714edb3-19a1-4cea-b726-b84f734dc8df tempest-VolumesSnapshotTestJSON-320297079 None] Created reservations ['674af36f-ca57-46be-b1b3-c514a1a4abca', 'd1fe76f5-deeb-4db2-b2f4-84a0d93a062e', '85562ecf-1998-4d36-a25e-bfa727120427', '00edae05-de95-4d80-9c9c-960c0442f4d5'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:18:20 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-a714edb3-19a1-4cea-b726-b84f734dc8df tempest-VolumesSnapshotTestJSON-320297079 None] Delete snapshot completed successfully. Sep 23 15:18:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a714edb3-19a1-4cea-b726-b84f734dc8df tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-b8447c3a-0655-4b7f-8b58-1c44b78a6b07-delete_snapshot" released by "delete_snapshot" :: held 2.250s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:18:21 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:18:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Flow 'volume_create_manager' (9986b3ba-c461-4dd6-a40e-1001e98892f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:18:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e62122-9f11-4a34-a28c-1c55f7e7d7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e62122-9f11-4a34-a28c-1c55f7e7d7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-685028551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a419c1f1-5025-4a17-b272-3757e00856d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d31d4dba76634dcab253598f353b1dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:18:22Z,use_quota=True,user_id='43df1514de1e40438105f9227dd79daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe37fa84-6568-4539-87c6-0597a55be2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe37fa84-6568-4539-87c6-0597a55be2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17de14c8-4c82-467b-b3bf-291e3e0d8b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17de14c8-4c82-467b-b3bf-291e3e0d8b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a419c1f1-5025-4a17-b272-3757e00856d8', 'volume_name': 'volume-a419c1f1-5025-4a17-b272-3757e00856d8', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66473915-d735-48d5-8ebf-875ced1c7469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66473915-d735-48d5-8ebf-875ced1c7469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc8aae8-cc5a-40ee-9fec-66e6d29fd07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:21 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Volume a419c1f1-5025-4a17-b272-3757e00856d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a419c1f1-5025-4a17-b272-3757e00856d8', 'volume_size': 1} Sep 23 15:18:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-685028551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a419c1f1-5025-4a17-b272-3757e00856d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d31d4dba76634dcab253598f353b1dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:18:22Z,use_quota=True,user_id='43df1514de1e40438105f9227dd79daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:18:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Creating volume a419c1f1-5025-4a17-b272-3757e00856d8 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:18:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:18:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:18:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:18:21 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:18:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:21 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8 1073741824 Sep 23 15:18:21 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:22 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8 1073741824" returned: 0 in 0.505s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:22 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8 Sep 23 15:18:22 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:22 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8" returned: 0 in 0.246s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:18:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc8aae8-cc5a-40ee-9fec-66e6d29fd07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a419c1f1-5025-4a17-b272-3757e00856d8', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a4d26e-db76-4479-a887-3f26dea6ce03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:22 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Volume volume-a419c1f1-5025-4a17-b272-3757e00856d8 (a419c1f1-5025-4a17-b272-3757e00856d8): created successfully Sep 23 15:18:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a4d26e-db76-4479-a887-3f26dea6ce03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Flow 'volume_create_manager' (9986b3ba-c461-4dd6-a40e-1001e98892f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:18:22 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f6dd7823-32b0-4b15-83ca-af4c91d62ffb tempest-VolumesSnapshotTestJSON-320297079 None] Created volume successfully. Sep 23 15:18:23 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-cc3f4a37-117a-4833-b0c4-31dad39400ca tempest-GroupsV320Test-1936694213 None] Group tempest-GroupsV320Test-Group-400792389: creating Sep 23 15:18:23 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-cc3f4a37-117a-4833-b0c4-31dad39400ca tempest-GroupsV320Test-1936694213 None] Group tempest-GroupsV320Test-Group-400792389: created successfully Sep 23 15:18:23 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-cc3f4a37-117a-4833-b0c4-31dad39400ca tempest-GroupsV320Test-1936694213 None] Create group completed successfully. Sep 23 15:18:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9d16c863-2967-4c2d-a4ab-1473f33a76b9 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9d16c863-2967-4c2d-a4ab-1473f33a76b9 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-9d16c863-2967-4c2d-a4ab-1473f33a76b9 tempest-VolumesSnapshotTestJSON-320297079 None] Creating offline snapshot c68de72e-3c5b-414a-ae46-b5893fb29762 of volume a419c1f1-5025-4a17-b272-3757e00856d8 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:18:24 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d73658-459c-4583-86ac-cf2eba0d0d1d]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:18:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9d16c863-2967-4c2d-a4ab-1473f33a76b9 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:24 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8 Sep 23 15:18:24 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:24 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9d16c863-2967-4c2d-a4ab-1473f33a76b9 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8" returned: 0 in 0.497s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9d16c863-2967-4c2d-a4ab-1473f33a76b9 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:24 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762 1G Sep 23 15:18:24 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:24 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Flow 'volume_create_manager' (e51f4f03-5190-4819-ae7c-bbdbbc84dafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cfaf69a-aa17-40e5-8475-78d01ca78bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cfaf69a-aa17-40e5-8475-78d01ca78bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2063686988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de604b6-5040-4e48-a35e-ba6abfd78634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a9bf43a15d48d5a50c88c02a9dcb29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:18:25Z,use_quota=True,user_id='2106c3908ce34d3fb650651ea861764f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82570b56-6c6a-4dc6-95b0-4a397b44250f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82570b56-6c6a-4dc6-95b0-4a397b44250f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78fa49ed-b098-4a1c-a354-5ea5f5187a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78fa49ed-b098-4a1c-a354-5ea5f5187a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5de604b6-5040-4e48-a35e-ba6abfd78634', 'volume_name': 'volume-5de604b6-5040-4e48-a35e-ba6abfd78634', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ca71b6-63e9-4924-be69-96cc15ed731d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ca71b6-63e9-4924-be69-96cc15ed731d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5beb0aa-1676-4911-9424-e845c54a61df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:25 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Volume 5de604b6-5040-4e48-a35e-ba6abfd78634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5de604b6-5040-4e48-a35e-ba6abfd78634', 'volume_size': 1} Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-7d96c0ba-6832-4e0b-85f6-fd24a5e20895 tempest-GroupsV320Test-1936694213 None] Created reservations ['e4e1870f-305c-4336-b574-f75e133827fc'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7d96c0ba-6832-4e0b-85f6-fd24a5e20895 tempest-GroupsV320Test-1936694213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7d96c0ba-6832-4e0b-85f6-fd24a5e20895 tempest-GroupsV320Test-1936694213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7d96c0ba-6832-4e0b-85f6-fd24a5e20895 tempest-GroupsV320Test-1936694213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7d96c0ba-6832-4e0b-85f6-fd24a5e20895 tempest-GroupsV320Test-1936694213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7d96c0ba-6832-4e0b-85f6-fd24a5e20895 tempest-GroupsV320Test-1936694213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7d96c0ba-6832-4e0b-85f6-fd24a5e20895 tempest-GroupsV320Test-1936694213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:25 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9d16c863-2967-4c2d-a4ab-1473f33a76b9 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762 1G" returned: 0 in 0.681s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9d16c863-2967-4c2d-a4ab-1473f33a76b9 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a419c1f1-5025-4a17-b272-3757e00856d8 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:25 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:18:25 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:25 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a419c1f1-5025-4a17-b272-3757e00856d8 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762 Sep 23 15:18:25 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:25 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7d96c0ba-6832-4e0b-85f6-fd24a5e20895 tempest-GroupsV320Test-1936694213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.269s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-7d96c0ba-6832-4e0b-85f6-fd24a5e20895 tempest-GroupsV320Test-1936694213 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:18:25 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7d96c0ba-6832-4e0b-85f6-fd24a5e20895 tempest-GroupsV320Test-1936694213 None] Delete group completed successfully. Sep 23 15:18:25 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9d16c863-2967-4c2d-a4ab-1473f33a76b9 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a419c1f1-5025-4a17-b272-3757e00856d8 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762" returned: 0 in 0.374s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:25 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-9d16c863-2967-4c2d-a4ab-1473f33a76b9 tempest-VolumesSnapshotTestJSON-320297079 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762 is being set with open permissions: ugo+rw Sep 23 15:18:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9d16c863-2967-4c2d-a4ab-1473f33a76b9 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:25 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762 Sep 23 15:18:25 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:26 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9d16c863-2967-4c2d-a4ab-1473f33a76b9 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762" returned: 0 in 0.400s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9d16c863-2967-4c2d-a4ab-1473f33a76b9 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:26 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.info Sep 23 15:18:26 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:26 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-25ea059e-8cd4-4336-8921-35c39bd00974 req-f7784216-74a2-42f0-b5a6-e21224f8bfe5 tempest-TestShelveInstance-1752068730 None] Terminate volume connection completed successfully. Sep 23 15:18:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-25ea059e-8cd4-4336-8921-35c39bd00974 req-f7784216-74a2-42f0-b5a6-e21224f8bfe5 tempest-TestShelveInstance-1752068730 None] Deleting attachment a5e94e3b-5e4f-40b6-9845-b925f98fe497. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:18:26 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9d16c863-2967-4c2d-a4ab-1473f33a76b9 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.info" returned: 0 in 0.312s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:26 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-9d16c863-2967-4c2d-a4ab-1473f33a76b9 tempest-VolumesSnapshotTestJSON-320297079 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.info is being set with open permissions: ugo+rw Sep 23 15:18:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9d16c863-2967-4c2d-a4ab-1473f33a76b9 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:26 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.info Sep 23 15:18:26 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:26 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9d16c863-2967-4c2d-a4ab-1473f33a76b9 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.info" returned: 0 in 0.279s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9d16c863-2967-4c2d-a4ab-1473f33a76b9 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.688s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.630s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2063686988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de604b6-5040-4e48-a35e-ba6abfd78634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a9bf43a15d48d5a50c88c02a9dcb29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:18:25Z,use_quota=True,user_id='2106c3908ce34d3fb650651ea861764f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:18:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Creating volume 5de604b6-5040-4e48-a35e-ba6abfd78634 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:18:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:18:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:18:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:18:26 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:18:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5de604b6-5040-4e48-a35e-ba6abfd78634 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:26 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5de604b6-5040-4e48-a35e-ba6abfd78634 1073741824 Sep 23 15:18:26 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:26 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-9d16c863-2967-4c2d-a4ab-1473f33a76b9 tempest-VolumesSnapshotTestJSON-320297079 None] Create snapshot completed successfully Sep 23 15:18:27 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5de604b6-5040-4e48-a35e-ba6abfd78634 1073741824" returned: 0 in 0.566s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5de604b6-5040-4e48-a35e-ba6abfd78634 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:27 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5de604b6-5040-4e48-a35e-ba6abfd78634 Sep 23 15:18:27 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:27 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5de604b6-5040-4e48-a35e-ba6abfd78634" returned: 0 in 0.308s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:27 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:18:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5beb0aa-1676-4911-9424-e845c54a61df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5de604b6-5040-4e48-a35e-ba6abfd78634', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ca446a-ba4a-4ffb-8ef9-f897d24c00a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:27 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Volume volume-5de604b6-5040-4e48-a35e-ba6abfd78634 (5de604b6-5040-4e48-a35e-ba6abfd78634): created successfully Sep 23 15:18:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ca446a-ba4a-4ffb-8ef9-f897d24c00a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Flow 'volume_create_manager' (e51f4f03-5190-4819-ae7c-bbdbbc84dafa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:18:27 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-a3b17d12-cb50-452e-8e83-63fbc6eb6f57 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Created volume successfully. Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Flow 'volume_create_manager' (37635773-5ee8-42f5-896e-46b0d55e0a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98881c1a-9efe-4e8c-8e07-c395ae569d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98881c1a-9efe-4e8c-8e07-c395ae569d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-23346116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6b1aac-0d06-4046-8d71-ed8fbea81eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d31d4dba76634dcab253598f353b1dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:18:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c68de72e-3c5b-414a-ae46-b5893fb29762,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:18:28Z,use_quota=True,user_id='43df1514de1e40438105f9227dd79daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4297f1c0-cf59-450a-9f88-0b8d24812759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4297f1c0-cf59-450a-9f88-0b8d24812759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21b81e1-1a8e-4e2d-a381-0f399a551812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21b81e1-1a8e-4e2d-a381-0f399a551812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ba6b1aac-0d06-4046-8d71-ed8fbea81eab', 'volume_name': 'volume-ba6b1aac-0d06-4046-8d71-ed8fbea81eab', 'volume_size': 2, 'snapshot_id': 'c68de72e-3c5b-414a-ae46-b5893fb29762'}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9667a39d-323b-4d03-8f2c-18971aa370c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9667a39d-323b-4d03-8f2c-18971aa370c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fecc5fd-5dc9-47f0-9155-4a7c915684d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:28 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Volume ba6b1aac-0d06-4046-8d71-ed8fbea81eab: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ba6b1aac-0d06-4046-8d71-ed8fbea81eab', 'volume_size': 2, 'snapshot_id': 'c68de72e-3c5b-414a-ae46-b5893fb29762'} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-quobyte-c68de72e-3c5b-414a-ae46-b5893fb29762-ba6b1aac-0d06-4046-8d71-ed8fbea81eab" by "_create_volume_from_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-c68de72e-3c5b-414a-ae46-b5893fb29762-ba6b1aac-0d06-4046-8d71-ed8fbea81eab" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Creating volume ba6b1aac-0d06-4046-8d71-ed8fbea81eab from snapshot c68de72e-3c5b-414a-ae46-b5893fb29762 {{(pid=86064) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-quobyte-ba6b1aac-0d06-4046-8d71-ed8fbea81eab" by "_copy_volume_from_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-ba6b1aac-0d06-4046-8d71-ed8fbea81eab" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] snapshot: c68de72e-3c5b-414a-ae46-b5893fb29762, volume: ba6b1aac-0d06-4046-8d71-ed8fbea81eab, {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33e5510-eb14-4afd-9ee2-fb5f819d2b5f]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:18:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:28 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762 Sep 23 15:18:28 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:29 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762" returned: 0 in 0.568s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a419c1f1-5025-4a17-b272-3757e00856d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:18:29 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0e98e1-d06a-44ec-8bb7-d699f0810189]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:18:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:29 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8 Sep 23 15:18:29 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-8c8106d9-11d5-4906-a403-eb58ed43e392 req-e87d4c26-b95a-49d6-9aee-0a4aa6a633c3 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:29 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8" returned: 0 in 0.578s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8 {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 15:18:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Creating direct copy from snapshot {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 15:18:29 devstack cinder-volume[86064]: DEBUG cinder.utils [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Path /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba6b1aac-0d06-4046-8d71-ed8fbea81eab not found in is_blk_device check {{(pid=86064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 15:18:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba6b1aac-0d06-4046-8d71-ed8fbea81eab {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:29 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba6b1aac-0d06-4046-8d71-ed8fbea81eab Sep 23 15:18:29 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-93bbd7ed-06f8-4c01-b7e9-46136c9626c3 req-c1a7e6a9-4f93-4a95-8778-330e519cf0e2 tempest-TestShelveInstance-1752068730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:36 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:18:36 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:36 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.356s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:18:36 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 28 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba6b1aac-0d06-4046-8d71-ed8fbea81eab" returned: 0 in 6.865s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8, size 1024.00 MB, duration 6.87 sec, destination /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba6b1aac-0d06-4046-8d71-ed8fbea81eab {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:18:36 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Converted 1024.00 MB image at 149.14 MB/s Sep 23 15:18:36 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba6b1aac-0d06-4046-8d71-ed8fbea81eab is being set with open permissions: ugo+rw Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba6b1aac-0d06-4046-8d71-ed8fbea81eab {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:36 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba6b1aac-0d06-4046-8d71-ed8fbea81eab Sep 23 15:18:36 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:36 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba6b1aac-0d06-4046-8d71-ed8fbea81eab" returned: 0 in 0.235s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-ba6b1aac-0d06-4046-8d71-ed8fbea81eab" released by "_copy_volume_from_snapshot" :: held 8.377s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-c68de72e-3c5b-414a-ae46-b5893fb29762-ba6b1aac-0d06-4046-8d71-ed8fbea81eab" released by "_create_volume_from_snapshot" :: held 8.452s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.481s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-8c8106d9-11d5-4906-a403-eb58ed43e392 req-e87d4c26-b95a-49d6-9aee-0a4aa6a633c3 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.191s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-8c8106d9-11d5-4906-a403-eb58ed43e392 req-e87d4c26-b95a-49d6-9aee-0a4aa6a633c3 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-93bbd7ed-06f8-4c01-b7e9-46136c9626c3 req-c1a7e6a9-4f93-4a95-8778-330e519cf0e2 tempest-TestShelveInstance-1752068730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.775s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fecc5fd-5dc9-47f0-9155-4a7c915684d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba6b1aac-0d06-4046-8d71-ed8fbea81eab', 'volume_size': 2, 'snapshot_id': 'c68de72e-3c5b-414a-ae46-b5893fb29762'}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da63589-d11a-4ad3-b0e9-334817cf915d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-93bbd7ed-06f8-4c01-b7e9-46136c9626c3 req-c1a7e6a9-4f93-4a95-8778-330e519cf0e2 tempest-TestShelveInstance-1752068730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:36 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Volume volume-ba6b1aac-0d06-4046-8d71-ed8fbea81eab (ba6b1aac-0d06-4046-8d71-ed8fbea81eab): created successfully Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da63589-d11a-4ad3-b0e9-334817cf915d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Flow 'volume_create_manager' (37635773-5ee8-42f5-896e-46b0d55e0a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-8c8106d9-11d5-4906-a403-eb58ed43e392 req-e87d4c26-b95a-49d6-9aee-0a4aa6a633c3 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-5de604b6-5040-4e48-a35e-ba6abfd78634', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '243856c8-a773-4df8-998d-8640afec3482', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:18:36 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-cb4729e3-03b3-41de-b18c-5770dc96cb02 tempest-VolumesSnapshotTestJSON-320297079 None] Created volume successfully. Sep 23 15:18:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-93bbd7ed-06f8-4c01-b7e9-46136c9626c3 req-c1a7e6a9-4f93-4a95-8778-330e519cf0e2 tempest-TestShelveInstance-1752068730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-40a7bfba-448d-489b-abeb-d0dd97968257', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46c8218c-5b7c-4935-99a3-3982d83873c9', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:18:36 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-8c8106d9-11d5-4906-a403-eb58ed43e392 req-e87d4c26-b95a-49d6-9aee-0a4aa6a633c3 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] attachment_update completed successfully. Sep 23 15:18:36 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-93bbd7ed-06f8-4c01-b7e9-46136c9626c3 req-c1a7e6a9-4f93-4a95-8778-330e519cf0e2 tempest-TestShelveInstance-1752068730 None] attachment_update completed successfully. Sep 23 15:18:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e677f99f-ec7c-4b0e-89ce-2e7a7041a513 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-ba6b1aac-0d06-4046-8d71-ed8fbea81eab-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:18:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e677f99f-ec7c-4b0e-89ce-2e7a7041a513 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-ba6b1aac-0d06-4046-8d71-ed8fbea81eab-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:18:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e677f99f-ec7c-4b0e-89ce-2e7a7041a513 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-quobyte-ba6b1aac-0d06-4046-8d71-ed8fbea81eab" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:18:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e677f99f-ec7c-4b0e-89ce-2e7a7041a513 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-ba6b1aac-0d06-4046-8d71-ed8fbea81eab" acquired by "delete_volume" :: waited 0.041s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:18:37 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b789f03-0d34-4eb9-9c8b-798394d1df44]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:18:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e677f99f-ec7c-4b0e-89ce-2e7a7041a513 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba6b1aac-0d06-4046-8d71-ed8fbea81eab {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:37 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba6b1aac-0d06-4046-8d71-ed8fbea81eab Sep 23 15:18:37 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:38 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e677f99f-ec7c-4b0e-89ce-2e7a7041a513 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba6b1aac-0d06-4046-8d71-ed8fbea81eab" returned: 0 in 0.558s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e677f99f-ec7c-4b0e-89ce-2e7a7041a513 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba6b1aac-0d06-4046-8d71-ed8fbea81eab {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:38 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba6b1aac-0d06-4046-8d71-ed8fbea81eab Sep 23 15:18:38 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:38 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e677f99f-ec7c-4b0e-89ce-2e7a7041a513 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba6b1aac-0d06-4046-8d71-ed8fbea81eab" returned: 0 in 0.427s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e677f99f-ec7c-4b0e-89ce-2e7a7041a513 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-ba6b1aac-0d06-4046-8d71-ed8fbea81eab" released by "delete_volume" :: held 1.060s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:18:38 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-e677f99f-ec7c-4b0e-89ce-2e7a7041a513 tempest-VolumesSnapshotTestJSON-320297079 None] Created reservations ['e26712d5-acf6-4964-8adf-47953b07c78c', '26d49c6c-bfc9-4fec-97b9-5c28e096ebcc', '56e8af57-a668-4ff8-b1c2-ca6356b50664', '6c8da24e-9df6-4633-881b-9f2fad3d5a85'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:18:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e677f99f-ec7c-4b0e-89ce-2e7a7041a513 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e677f99f-ec7c-4b0e-89ce-2e7a7041a513 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e677f99f-ec7c-4b0e-89ce-2e7a7041a513 tempest-VolumesSnapshotTestJSON-320297079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:18:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e677f99f-ec7c-4b0e-89ce-2e7a7041a513 tempest-VolumesSnapshotTestJSON-320297079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:18:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e677f99f-ec7c-4b0e-89ce-2e7a7041a513 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e677f99f-ec7c-4b0e-89ce-2e7a7041a513 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:38 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:18:38 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:39 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e677f99f-ec7c-4b0e-89ce-2e7a7041a513 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.378s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:39 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-e677f99f-ec7c-4b0e-89ce-2e7a7041a513 tempest-VolumesSnapshotTestJSON-320297079 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:18:39 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-e677f99f-ec7c-4b0e-89ce-2e7a7041a513 tempest-VolumesSnapshotTestJSON-320297079 None] Deleted volume successfully. Sep 23 15:18:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e677f99f-ec7c-4b0e-89ce-2e7a7041a513 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-ba6b1aac-0d06-4046-8d71-ed8fbea81eab-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:18:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a2ff9e4b-8d00-44c3-aa1f-4ab729c36017 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-c68de72e-3c5b-414a-ae46-b5893fb29762-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:18:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a2ff9e4b-8d00-44c3-aa1f-4ab729c36017 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-c68de72e-3c5b-414a-ae46-b5893fb29762-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:18:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a2ff9e4b-8d00-44c3-aa1f-4ab729c36017 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-quobyte-a419c1f1-5025-4a17-b272-3757e00856d8" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:18:40 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a2ff9e4b-8d00-44c3-aa1f-4ab729c36017 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-a419c1f1-5025-4a17-b272-3757e00856d8" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:18:40 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a2ff9e4b-8d00-44c3-aa1f-4ab729c36017 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-quobyte-c68de72e-3c5b-414a-ae46-b5893fb29762" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:18:40 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a2ff9e4b-8d00-44c3-aa1f-4ab729c36017 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-c68de72e-3c5b-414a-ae46-b5893fb29762" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:18:40 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-a2ff9e4b-8d00-44c3-aa1f-4ab729c36017 tempest-VolumesSnapshotTestJSON-320297079 None] Deleting offline snapshot c68de72e-3c5b-414a-ae46-b5893fb29762 of volume a419c1f1-5025-4a17-b272-3757e00856d8 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:18:40 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-a2ff9e4b-8d00-44c3-aa1f-4ab729c36017 tempest-VolumesSnapshotTestJSON-320297079 None] snapshot_file for this snap is: volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:18:40 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffd3842-38a4-4819-a56d-13a71fa0c724]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:18:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a2ff9e4b-8d00-44c3-aa1f-4ab729c36017 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:40 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762 Sep 23 15:18:40 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:40 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-daf21323-4919-4371-aff7-b3d02f60aa32 req-ef60b8e3-d42d-4979-8ab2-e1248d094815 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Terminate volume connection completed successfully. Sep 23 15:18:40 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-daf21323-4919-4371-aff7-b3d02f60aa32 req-ef60b8e3-d42d-4979-8ab2-e1248d094815 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Deleting attachment 243856c8-a773-4df8-998d-8640afec3482. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:18:40 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a2ff9e4b-8d00-44c3-aa1f-4ab729c36017 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762" returned: 0 in 0.539s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:40 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-a2ff9e4b-8d00-44c3-aa1f-4ab729c36017 tempest-VolumesSnapshotTestJSON-320297079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a419c1f1-5025-4a17-b272-3757e00856d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:18:40 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9287a83c-3f85-49ca-94b9-4708780a6a32]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:18:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a2ff9e4b-8d00-44c3-aa1f-4ab729c36017 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:40 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8 Sep 23 15:18:40 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bac19fcb-bc0d-4a5f-823d-686da26355b5 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Acquiring lock "cinder-5de604b6-5040-4e48-a35e-ba6abfd78634-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:18:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bac19fcb-bc0d-4a5f-823d-686da26355b5 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Lock "cinder-5de604b6-5040-4e48-a35e-ba6abfd78634-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:18:41 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a2ff9e4b-8d00-44c3-aa1f-4ab729c36017 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8" returned: 0 in 1.075s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a2ff9e4b-8d00-44c3-aa1f-4ab729c36017 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:41 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762 Sep 23 15:18:41 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bac19fcb-bc0d-4a5f-823d-686da26355b5 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Acquiring lock "cinder-quobyte-5de604b6-5040-4e48-a35e-ba6abfd78634" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:18:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bac19fcb-bc0d-4a5f-823d-686da26355b5 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Lock "cinder-quobyte-5de604b6-5040-4e48-a35e-ba6abfd78634" acquired by "delete_volume" :: waited 0.027s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:18:41 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdc3d6d-bf5d-4287-ab27-811ae3272d22]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:18:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bac19fcb-bc0d-4a5f-823d-686da26355b5 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5de604b6-5040-4e48-a35e-ba6abfd78634 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:42 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5de604b6-5040-4e48-a35e-ba6abfd78634 Sep 23 15:18:42 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:42 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a2ff9e4b-8d00-44c3-aa1f-4ab729c36017 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762" returned: 0 in 0.869s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a2ff9e4b-8d00-44c3-aa1f-4ab729c36017 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:42 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bac19fcb-bc0d-4a5f-823d-686da26355b5 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5de604b6-5040-4e48-a35e-ba6abfd78634" returned: 0 in 0.708s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bac19fcb-bc0d-4a5f-823d-686da26355b5 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5de604b6-5040-4e48-a35e-ba6abfd78634 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:42 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762 Sep 23 15:18:42 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:42 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5de604b6-5040-4e48-a35e-ba6abfd78634 Sep 23 15:18:42 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:42 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a2ff9e4b-8d00-44c3-aa1f-4ab729c36017 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8.c68de72e-3c5b-414a-ae46-b5893fb29762" returned: 0 in 0.322s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a2ff9e4b-8d00-44c3-aa1f-4ab729c36017 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-c68de72e-3c5b-414a-ae46-b5893fb29762" released by "_delete_snapshot" :: held 2.999s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:18:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a2ff9e4b-8d00-44c3-aa1f-4ab729c36017 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-a419c1f1-5025-4a17-b272-3757e00856d8" released by "delete_snapshot" :: held 3.039s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:18:43 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bac19fcb-bc0d-4a5f-823d-686da26355b5 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5de604b6-5040-4e48-a35e-ba6abfd78634" returned: 0 in 0.414s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bac19fcb-bc0d-4a5f-823d-686da26355b5 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Lock "cinder-quobyte-5de604b6-5040-4e48-a35e-ba6abfd78634" released by "delete_volume" :: held 1.223s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:18:43 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-a2ff9e4b-8d00-44c3-aa1f-4ab729c36017 tempest-VolumesSnapshotTestJSON-320297079 None] Created reservations ['60fce91c-8382-485d-93d5-8975b881ccab', '7af91559-3342-4d71-bab0-65fdf62d1681', '43c53b14-118c-4291-a2a4-2c13783cf1d6', '63ea6f5a-b72f-4563-a0c8-b2bdb954c249'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:18:43 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-bac19fcb-bc0d-4a5f-823d-686da26355b5 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Created reservations ['5ecd800e-03eb-455f-bc8c-e1faf0f04ee0', 'a88900b5-cb0e-4ab6-8db6-c3e7b72faaba', 'dfd92376-f53a-42db-9de2-e4435bec9f1f', '9d7281bf-df28-4db7-b851-268883760bbd'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:18:43 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-a2ff9e4b-8d00-44c3-aa1f-4ab729c36017 tempest-VolumesSnapshotTestJSON-320297079 None] Delete snapshot completed successfully. Sep 23 15:18:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a2ff9e4b-8d00-44c3-aa1f-4ab729c36017 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-c68de72e-3c5b-414a-ae46-b5893fb29762-delete_snapshot" released by "delete_snapshot" :: held 3.447s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:18:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bac19fcb-bc0d-4a5f-823d-686da26355b5 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bac19fcb-bc0d-4a5f-823d-686da26355b5 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:43 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bac19fcb-bc0d-4a5f-823d-686da26355b5 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:18:43 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bac19fcb-bc0d-4a5f-823d-686da26355b5 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:18:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bac19fcb-bc0d-4a5f-823d-686da26355b5 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bac19fcb-bc0d-4a5f-823d-686da26355b5 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:43 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:18:43 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:43 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bac19fcb-bc0d-4a5f-823d-686da26355b5 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.300s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:43 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-bac19fcb-bc0d-4a5f-823d-686da26355b5 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:18:43 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-bac19fcb-bc0d-4a5f-823d-686da26355b5 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Deleted volume successfully. Sep 23 15:18:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bac19fcb-bc0d-4a5f-823d-686da26355b5 tempest-TestServerVolumeAttachScenarioOldVersion-1826547875 None] Lock "cinder-5de604b6-5040-4e48-a35e-ba6abfd78634-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:18:44 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-769e9b23-2c1e-478f-b643-e57d5777d35d tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-a419c1f1-5025-4a17-b272-3757e00856d8-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:18:44 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-769e9b23-2c1e-478f-b643-e57d5777d35d tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-a419c1f1-5025-4a17-b272-3757e00856d8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:18:44 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-769e9b23-2c1e-478f-b643-e57d5777d35d tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-quobyte-a419c1f1-5025-4a17-b272-3757e00856d8" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:18:44 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-769e9b23-2c1e-478f-b643-e57d5777d35d tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-a419c1f1-5025-4a17-b272-3757e00856d8" acquired by "delete_volume" :: waited 0.050s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:18:44 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9574e76e-a442-4cc6-b591-7db071ae68ee]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:18:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-769e9b23-2c1e-478f-b643-e57d5777d35d tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:45 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8 Sep 23 15:18:45 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:45 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-769e9b23-2c1e-478f-b643-e57d5777d35d tempest-VolumesSnapshotTestJSON-320297079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8" returned: 0 in 0.790s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-769e9b23-2c1e-478f-b643-e57d5777d35d tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:45 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8 Sep 23 15:18:45 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:46 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-769e9b23-2c1e-478f-b643-e57d5777d35d tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a419c1f1-5025-4a17-b272-3757e00856d8" returned: 0 in 0.405s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-769e9b23-2c1e-478f-b643-e57d5777d35d tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-a419c1f1-5025-4a17-b272-3757e00856d8" released by "delete_volume" :: held 1.485s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:18:46 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-769e9b23-2c1e-478f-b643-e57d5777d35d tempest-VolumesSnapshotTestJSON-320297079 None] Created reservations ['68db9282-8f96-4cf0-84bd-0b2768c522b8', '32baf6cc-fd55-4d6d-8b11-a165d3e31980', 'd71fef92-5000-4918-bc82-d338e1fc16a3', '59edbcd1-2481-4cfc-ac60-e623ae6f6acd'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:18:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-769e9b23-2c1e-478f-b643-e57d5777d35d tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-769e9b23-2c1e-478f-b643-e57d5777d35d tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-769e9b23-2c1e-478f-b643-e57d5777d35d tempest-VolumesSnapshotTestJSON-320297079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:18:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-769e9b23-2c1e-478f-b643-e57d5777d35d tempest-VolumesSnapshotTestJSON-320297079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:18:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-769e9b23-2c1e-478f-b643-e57d5777d35d tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-769e9b23-2c1e-478f-b643-e57d5777d35d tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:46 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:18:46 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:46 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-769e9b23-2c1e-478f-b643-e57d5777d35d tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.314s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:46 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-769e9b23-2c1e-478f-b643-e57d5777d35d tempest-VolumesSnapshotTestJSON-320297079 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:18:46 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-769e9b23-2c1e-478f-b643-e57d5777d35d tempest-VolumesSnapshotTestJSON-320297079 None] Deleted volume successfully. Sep 23 15:18:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-769e9b23-2c1e-478f-b643-e57d5777d35d tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-a419c1f1-5025-4a17-b272-3757e00856d8-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:18:47 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:18:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Flow 'volume_create_manager' (9771c8a7-0c13-46c3-9e5a-0d019dba455f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:18:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45d5d2d7-b11b-4a39-8aed-0f435a537195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45d5d2d7-b11b-4a39-8aed-0f435a537195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-784329224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6e1a287-56bc-4e90-a63f-5a6e13a59a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d31d4dba76634dcab253598f353b1dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:18:48Z,use_quota=True,user_id='43df1514de1e40438105f9227dd79daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b78bce6-e293-4791-987b-a7106f2d6cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b78bce6-e293-4791-987b-a7106f2d6cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ef235a-ebe4-4f90-9077-b17d73262f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ef235a-ebe4-4f90-9077-b17d73262f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6e1a287-56bc-4e90-a63f-5a6e13a59a0b', 'volume_name': 'volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d38666-3949-481e-a6b2-59f125bbbc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d38666-3949-481e-a6b2-59f125bbbc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24793626-a1b6-4363-9f33-14a45cf66885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:47 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Volume b6e1a287-56bc-4e90-a63f-5a6e13a59a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b', 'volume_size': 1} Sep 23 15:18:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:47 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-784329224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6e1a287-56bc-4e90-a63f-5a6e13a59a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d31d4dba76634dcab253598f353b1dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:18:48Z,use_quota=True,user_id='43df1514de1e40438105f9227dd79daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:18:47 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Creating volume b6e1a287-56bc-4e90-a63f-5a6e13a59a0b {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:18:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:47 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:18:47 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:18:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:47 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:18:47 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:18:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:47 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b 1073741824 Sep 23 15:18:47 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:48 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b 1073741824" returned: 0 in 0.882s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:48 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b Sep 23 15:18:48 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:49 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b" returned: 0 in 0.288s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:18:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24793626-a1b6-4363-9f33-14a45cf66885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13cfedcb-aeb5-45b6-a012-43385f0b430b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:49 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Volume volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b (b6e1a287-56bc-4e90-a63f-5a6e13a59a0b): created successfully Sep 23 15:18:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13cfedcb-aeb5-45b6-a012-43385f0b430b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Flow 'volume_create_manager' (9771c8a7-0c13-46c3-9e5a-0d019dba455f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:18:49 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5a47b568-1fb8-48bc-a638-cfe1154cad48 tempest-VolumesSnapshotTestJSON-320297079 None] Created volume successfully. Sep 23 15:18:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-be8eecdf-e397-4266-bd5c-de02f49b4a3f tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-be8eecdf-e397-4266-bd5c-de02f49b4a3f tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:50 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-be8eecdf-e397-4266-bd5c-de02f49b4a3f tempest-VolumesSnapshotTestJSON-320297079 None] Creating offline snapshot 5fd1f51b-d83a-4420-a7f6-b601f2197e9e of volume b6e1a287-56bc-4e90-a63f-5a6e13a59a0b {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:18:50 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e7538b-4e66-4581-af60-1ab1b34a3f14]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:18:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-be8eecdf-e397-4266-bd5c-de02f49b4a3f tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:50 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b Sep 23 15:18:50 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:50 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-be8eecdf-e397-4266-bd5c-de02f49b4a3f tempest-VolumesSnapshotTestJSON-320297079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b" returned: 0 in 0.520s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-be8eecdf-e397-4266-bd5c-de02f49b4a3f tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:50 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e 1G Sep 23 15:18:50 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:51 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-be8eecdf-e397-4266-bd5c-de02f49b4a3f tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e 1G" returned: 0 in 0.540s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-be8eecdf-e397-4266-bd5c-de02f49b4a3f tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:51 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e Sep 23 15:18:51 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:51 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-be8eecdf-e397-4266-bd5c-de02f49b4a3f tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e" returned: 0 in 0.411s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:51 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-be8eecdf-e397-4266-bd5c-de02f49b4a3f tempest-VolumesSnapshotTestJSON-320297079 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e is being set with open permissions: ugo+rw Sep 23 15:18:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-be8eecdf-e397-4266-bd5c-de02f49b4a3f tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:51 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e Sep 23 15:18:51 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:51 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-be8eecdf-e397-4266-bd5c-de02f49b4a3f tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e" returned: 0 in 0.333s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-be8eecdf-e397-4266-bd5c-de02f49b4a3f tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:52 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.info Sep 23 15:18:52 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:52 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-be8eecdf-e397-4266-bd5c-de02f49b4a3f tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.info" returned: 0 in 0.360s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:52 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-be8eecdf-e397-4266-bd5c-de02f49b4a3f tempest-VolumesSnapshotTestJSON-320297079 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.info is being set with open permissions: ugo+rw Sep 23 15:18:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-be8eecdf-e397-4266-bd5c-de02f49b4a3f tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:52 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.info Sep 23 15:18:52 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:52 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-be8eecdf-e397-4266-bd5c-de02f49b4a3f tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.info" returned: 0 in 0.420s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-be8eecdf-e397-4266-bd5c-de02f49b4a3f tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.728s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:52 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-be8eecdf-e397-4266-bd5c-de02f49b4a3f tempest-VolumesSnapshotTestJSON-320297079 None] Create snapshot completed successfully Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Flow 'volume_create_manager' (7c82a8c8-51a1-44f8-bef4-88c782c93850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c11cf1-2b26-4004-9115-bf92da3a37e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c11cf1-2b26-4004-9115-bf92da3a37e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1732971241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d5f1f26-0a0f-4431-86a3-c9201c7bac3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d31d4dba76634dcab253598f353b1dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5fd1f51b-d83a-4420-a7f6-b601f2197e9e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:18:54Z,use_quota=True,user_id='43df1514de1e40438105f9227dd79daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (716bda1b-506a-4f61-8a84-06f07632db0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (716bda1b-506a-4f61-8a84-06f07632db0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2030180d-9ec0-4a41-b3a0-2165771434f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2030180d-9ec0-4a41-b3a0-2165771434f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0d5f1f26-0a0f-4431-86a3-c9201c7bac3b', 'volume_name': 'volume-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b', 'volume_size': 1, 'snapshot_id': '5fd1f51b-d83a-4420-a7f6-b601f2197e9e'}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba4b74c-7544-42b8-9d0a-21b382028f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba4b74c-7544-42b8-9d0a-21b382028f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133f49f5-135b-40e5-9ed5-cbe638b0028d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:18:54 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Volume 0d5f1f26-0a0f-4431-86a3-c9201c7bac3b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b', 'volume_size': 1, 'snapshot_id': '5fd1f51b-d83a-4420-a7f6-b601f2197e9e'} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-quobyte-5fd1f51b-d83a-4420-a7f6-b601f2197e9e-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b" by "_create_volume_from_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-5fd1f51b-d83a-4420-a7f6-b601f2197e9e-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Creating volume 0d5f1f26-0a0f-4431-86a3-c9201c7bac3b from snapshot 5fd1f51b-d83a-4420-a7f6-b601f2197e9e {{(pid=86064) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-quobyte-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b" by "_copy_volume_from_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] snapshot: 5fd1f51b-d83a-4420-a7f6-b601f2197e9e, volume: 0d5f1f26-0a0f-4431-86a3-c9201c7bac3b, {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e82281d-d1b0-4201-85b9-3aadd764d379]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:54 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e Sep 23 15:18:54 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:54 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e" returned: 0 in 0.533s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:18:55 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[1115629b-f188-4f6f-afef-18ad166a816e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:18:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:55 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b Sep 23 15:18:55 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:18:55 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Sep 23 15:18:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b" returned: 0 in 0.643s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:18:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 15:18:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Creating direct copy from snapshot {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 15:18:55 devstack cinder-volume[86064]: DEBUG cinder.utils [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Path /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b not found in is_blk_device check {{(pid=86064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 15:18:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:18:55 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b Sep 23 15:18:55 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:04 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:19:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Flow 'volume_create_manager' (a1449bdf-4f1e-4453-a531-34be82651000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:19:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78586e3d-8d34-4258-8a9e-8eb5999c5e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78586e3d-8d34-4258-8a9e-8eb5999c5e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1988281336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ca3cae-c76a-4a65-bdb5-15a5b4ac006f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85fc3c47a2bb418a89a49a9577aab773',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:19:04Z,use_quota=True,user_id='fb512de8dbff404a9ee267b9a9549510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a06ae339-1558-486c-87b6-f34afa3c9313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a06ae339-1558-486c-87b6-f34afa3c9313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5882d2f0-c236-45f6-b986-6e9b70a4e910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5882d2f0-c236-45f6-b986-6e9b70a4e910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59ca3cae-c76a-4a65-bdb5-15a5b4ac006f', 'volume_name': 'volume-59ca3cae-c76a-4a65-bdb5-15a5b4ac006f', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f15d765-09ad-4d34-8e1b-38753493ccca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f15d765-09ad-4d34-8e1b-38753493ccca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7879efb2-9d43-441e-9d8b-f8351888f188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:04 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Volume 59ca3cae-c76a-4a65-bdb5-15a5b4ac006f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59ca3cae-c76a-4a65-bdb5-15a5b4ac006f', 'volume_size': 1} Sep 23 15:19:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:04 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b" returned: 0 in 9.123s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:04 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b, size 1024.00 MB, duration 9.12 sec, destination /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:19:04 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Converted 1024.00 MB image at 112.23 MB/s Sep 23 15:19:04 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b is being set with open permissions: ugo+rw Sep 23 15:19:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:04 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b Sep 23 15:19:04 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:05 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b" returned: 0 in 0.258s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b" released by "_copy_volume_from_snapshot" :: held 10.678s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:UPDATE=93,cinder:SELECT=97,cinder:INSERT=17,cinder:DELETE=8 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=98,cinder:UPDATE=83,cinder:INSERT=22,cinder:DELETE=3 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-5fd1f51b-d83a-4420-a7f6-b601f2197e9e-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b" released by "_create_volume_from_snapshot" :: held 10.764s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.783s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.650s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1988281336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ca3cae-c76a-4a65-bdb5-15a5b4ac006f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85fc3c47a2bb418a89a49a9577aab773',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:19:04Z,use_quota=True,user_id='fb512de8dbff404a9ee267b9a9549510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Creating volume 59ca3cae-c76a-4a65-bdb5-15a5b4ac006f {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:19:05 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-59ca3cae-c76a-4a65-bdb5-15a5b4ac006f 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:05 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-59ca3cae-c76a-4a65-bdb5-15a5b4ac006f 1073741824 Sep 23 15:19:05 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133f49f5-135b-40e5-9ed5-cbe638b0028d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b', 'volume_size': 1, 'snapshot_id': '5fd1f51b-d83a-4420-a7f6-b601f2197e9e'}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6a68b4-461f-403f-ba23-23a06dd76bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:05 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Volume volume-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b (0d5f1f26-0a0f-4431-86a3-c9201c7bac3b): created successfully Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6a68b4-461f-403f-ba23-23a06dd76bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Flow 'volume_create_manager' (7c82a8c8-51a1-44f8-bef4-88c782c93850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:19:05 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-4208869a-b83e-41dd-97e9-2e4d48847867 tempest-VolumesSnapshotTestJSON-320297079 None] Created volume successfully. Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5bc13fab-4e86-401c-a7d8-16d6f4c358cc tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5bc13fab-4e86-401c-a7d8-16d6f4c358cc tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5bc13fab-4e86-401c-a7d8-16d6f4c358cc tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-quobyte-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5bc13fab-4e86-401c-a7d8-16d6f4c358cc tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b" acquired by "delete_volume" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d529bf-d600-4b59-b05f-dbab148da416]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5bc13fab-4e86-401c-a7d8-16d6f4c358cc tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:05 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-59ca3cae-c76a-4a65-bdb5-15a5b4ac006f 1073741824" returned: 0 in 0.661s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-59ca3cae-c76a-4a65-bdb5-15a5b4ac006f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:05 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-59ca3cae-c76a-4a65-bdb5-15a5b4ac006f Sep 23 15:19:05 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:05 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b Sep 23 15:19:05 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:06 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-59ca3cae-c76a-4a65-bdb5-15a5b4ac006f" returned: 0 in 0.266s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7879efb2-9d43-441e-9d8b-f8351888f188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59ca3cae-c76a-4a65-bdb5-15a5b4ac006f', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894e274d-78b8-4cdc-b9b1-f861b4428f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:06 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Volume volume-59ca3cae-c76a-4a65-bdb5-15a5b4ac006f (59ca3cae-c76a-4a65-bdb5-15a5b4ac006f): created successfully Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894e274d-78b8-4cdc-b9b1-f861b4428f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Flow 'volume_create_manager' (a1449bdf-4f1e-4453-a531-34be82651000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:19:06 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-6ea640b5-e0fc-440e-a237-6700801ef151 tempest-VolumesServicesTestJSON-1750809663 None] Created volume successfully. Sep 23 15:19:06 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5bc13fab-4e86-401c-a7d8-16d6f4c358cc tempest-VolumesSnapshotTestJSON-320297079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b" returned: 0 in 0.436s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5bc13fab-4e86-401c-a7d8-16d6f4c358cc tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:06 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b Sep 23 15:19:06 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:06 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b75f3c7c-dec5-4737-91ad-5c08ae6edc56 tempest-VolumesServicesTestJSON-1750809663 None] Acquiring lock "cinder-59ca3cae-c76a-4a65-bdb5-15a5b4ac006f-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5bc13fab-4e86-401c-a7d8-16d6f4c358cc tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b" returned: 0 in 0.345s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5bc13fab-4e86-401c-a7d8-16d6f4c358cc tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b" released by "delete_volume" :: held 0.850s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b75f3c7c-dec5-4737-91ad-5c08ae6edc56 tempest-VolumesServicesTestJSON-1750809663 None] Lock "cinder-59ca3cae-c76a-4a65-bdb5-15a5b4ac006f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b75f3c7c-dec5-4737-91ad-5c08ae6edc56 tempest-VolumesServicesTestJSON-1750809663 None] Acquiring lock "cinder-quobyte-59ca3cae-c76a-4a65-bdb5-15a5b4ac006f" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b75f3c7c-dec5-4737-91ad-5c08ae6edc56 tempest-VolumesServicesTestJSON-1750809663 None] Lock "cinder-quobyte-59ca3cae-c76a-4a65-bdb5-15a5b4ac006f" acquired by "delete_volume" :: waited 0.033s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-5bc13fab-4e86-401c-a7d8-16d6f4c358cc tempest-VolumesSnapshotTestJSON-320297079 None] Created reservations ['84d0f92a-53f1-4c1a-84c8-26abf87b9eb0', '74c5609d-09b5-4223-951f-90bc223c065a', '4a7c6121-5e1a-464a-ae9a-ea54806a4371', 'e9c9f3a4-95c5-4d8d-9ea6-06df7fccf841'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7808661-2324-40e6-9ec9-12fd2ccd0daf]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b75f3c7c-dec5-4737-91ad-5c08ae6edc56 tempest-VolumesServicesTestJSON-1750809663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-59ca3cae-c76a-4a65-bdb5-15a5b4ac006f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5bc13fab-4e86-401c-a7d8-16d6f4c358cc tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5bc13fab-4e86-401c-a7d8-16d6f4c358cc tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5bc13fab-4e86-401c-a7d8-16d6f4c358cc tempest-VolumesSnapshotTestJSON-320297079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5bc13fab-4e86-401c-a7d8-16d6f4c358cc tempest-VolumesSnapshotTestJSON-320297079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5bc13fab-4e86-401c-a7d8-16d6f4c358cc tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5bc13fab-4e86-401c-a7d8-16d6f4c358cc tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:06 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-59ca3cae-c76a-4a65-bdb5-15a5b4ac006f Sep 23 15:19:06 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:06 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:19:06 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5f64e10a-ef4d-46a5-8da2-bb9a463e9cf9 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-5fd1f51b-d83a-4420-a7f6-b601f2197e9e-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5f64e10a-ef4d-46a5-8da2-bb9a463e9cf9 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-5fd1f51b-d83a-4420-a7f6-b601f2197e9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5f64e10a-ef4d-46a5-8da2-bb9a463e9cf9 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-quobyte-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5f64e10a-ef4d-46a5-8da2-bb9a463e9cf9 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5f64e10a-ef4d-46a5-8da2-bb9a463e9cf9 tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-quobyte-5fd1f51b-d83a-4420-a7f6-b601f2197e9e" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5f64e10a-ef4d-46a5-8da2-bb9a463e9cf9 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-5fd1f51b-d83a-4420-a7f6-b601f2197e9e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-5f64e10a-ef4d-46a5-8da2-bb9a463e9cf9 tempest-VolumesSnapshotTestJSON-320297079 None] Deleting offline snapshot 5fd1f51b-d83a-4420-a7f6-b601f2197e9e of volume b6e1a287-56bc-4e90-a63f-5a6e13a59a0b {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-5f64e10a-ef4d-46a5-8da2-bb9a463e9cf9 tempest-VolumesSnapshotTestJSON-320297079 None] snapshot_file for this snap is: volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef76476-d537-4249-9d4c-3d609b500633]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5f64e10a-ef4d-46a5-8da2-bb9a463e9cf9 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:07 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b75f3c7c-dec5-4737-91ad-5c08ae6edc56 tempest-VolumesServicesTestJSON-1750809663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-59ca3cae-c76a-4a65-bdb5-15a5b4ac006f" returned: 0 in 0.513s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b75f3c7c-dec5-4737-91ad-5c08ae6edc56 tempest-VolumesServicesTestJSON-1750809663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-59ca3cae-c76a-4a65-bdb5-15a5b4ac006f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:07 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:07 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-59ca3cae-c76a-4a65-bdb5-15a5b4ac006f Sep 23 15:19:07 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5bc13fab-4e86-401c-a7d8-16d6f4c358cc tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.454s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-5bc13fab-4e86-401c-a7d8-16d6f4c358cc tempest-VolumesSnapshotTestJSON-320297079 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:19:07 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5bc13fab-4e86-401c-a7d8-16d6f4c358cc tempest-VolumesSnapshotTestJSON-320297079 None] Deleted volume successfully. Sep 23 15:19:07 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e Sep 23 15:19:07 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5bc13fab-4e86-401c-a7d8-16d6f4c358cc tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-0d5f1f26-0a0f-4431-86a3-c9201c7bac3b-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:07 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b75f3c7c-dec5-4737-91ad-5c08ae6edc56 tempest-VolumesServicesTestJSON-1750809663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-59ca3cae-c76a-4a65-bdb5-15a5b4ac006f" returned: 0 in 0.383s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b75f3c7c-dec5-4737-91ad-5c08ae6edc56 tempest-VolumesServicesTestJSON-1750809663 None] Lock "cinder-quobyte-59ca3cae-c76a-4a65-bdb5-15a5b4ac006f" released by "delete_volume" :: held 0.958s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-b75f3c7c-dec5-4737-91ad-5c08ae6edc56 tempest-VolumesServicesTestJSON-1750809663 None] Created reservations ['4364574f-0175-4f25-a1bc-dda2d30609e9', '57a6e4e3-8e9d-4f25-a516-16e911b82a68', '941d9068-cfee-402a-add9-da0bdd0c9a02', '50a03fcb-be2f-4ea9-9772-42227dd5ab2f'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:19:07 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5f64e10a-ef4d-46a5-8da2-bb9a463e9cf9 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e" returned: 0 in 0.638s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-5f64e10a-ef4d-46a5-8da2-bb9a463e9cf9 tempest-VolumesSnapshotTestJSON-320297079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4458d949-173f-491f-88f9-7f92496c8c31]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5f64e10a-ef4d-46a5-8da2-bb9a463e9cf9 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b75f3c7c-dec5-4737-91ad-5c08ae6edc56 tempest-VolumesServicesTestJSON-1750809663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b75f3c7c-dec5-4737-91ad-5c08ae6edc56 tempest-VolumesServicesTestJSON-1750809663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b75f3c7c-dec5-4737-91ad-5c08ae6edc56 tempest-VolumesServicesTestJSON-1750809663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b75f3c7c-dec5-4737-91ad-5c08ae6edc56 tempest-VolumesServicesTestJSON-1750809663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b75f3c7c-dec5-4737-91ad-5c08ae6edc56 tempest-VolumesServicesTestJSON-1750809663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b75f3c7c-dec5-4737-91ad-5c08ae6edc56 tempest-VolumesServicesTestJSON-1750809663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:07 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:19:07 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:08 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b Sep 23 15:19:08 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:08 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b75f3c7c-dec5-4737-91ad-5c08ae6edc56 tempest-VolumesServicesTestJSON-1750809663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.376s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:08 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-b75f3c7c-dec5-4737-91ad-5c08ae6edc56 tempest-VolumesServicesTestJSON-1750809663 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:19:08 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-b75f3c7c-dec5-4737-91ad-5c08ae6edc56 tempest-VolumesServicesTestJSON-1750809663 None] Deleted volume successfully. Sep 23 15:19:08 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b75f3c7c-dec5-4737-91ad-5c08ae6edc56 tempest-VolumesServicesTestJSON-1750809663 None] Lock "cinder-59ca3cae-c76a-4a65-bdb5-15a5b4ac006f-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:08 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5f64e10a-ef4d-46a5-8da2-bb9a463e9cf9 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b" returned: 0 in 0.716s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5f64e10a-ef4d-46a5-8da2-bb9a463e9cf9 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:08 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e Sep 23 15:19:08 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:08 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5f64e10a-ef4d-46a5-8da2-bb9a463e9cf9 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e" returned: 0 in 0.397s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5f64e10a-ef4d-46a5-8da2-bb9a463e9cf9 tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:08 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e Sep 23 15:19:08 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:09 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5f64e10a-ef4d-46a5-8da2-bb9a463e9cf9 tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b.5fd1f51b-d83a-4420-a7f6-b601f2197e9e" returned: 0 in 0.298s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:09 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5f64e10a-ef4d-46a5-8da2-bb9a463e9cf9 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-5fd1f51b-d83a-4420-a7f6-b601f2197e9e" released by "_delete_snapshot" :: held 2.224s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:09 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5f64e10a-ef4d-46a5-8da2-bb9a463e9cf9 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b" released by "delete_snapshot" :: held 2.262s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:09 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-5f64e10a-ef4d-46a5-8da2-bb9a463e9cf9 tempest-VolumesSnapshotTestJSON-320297079 None] Created reservations ['cb784aa9-43c6-4d41-82b9-4b785275e618', '9e288b61-2924-4396-ad88-dd4cb115a508', '1c3a25b2-7097-4cce-8ec1-ef798b090b17', '3d72210e-496d-429e-9b41-74bef6751b43'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:19:09 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5f64e10a-ef4d-46a5-8da2-bb9a463e9cf9 tempest-VolumesSnapshotTestJSON-320297079 None] Delete snapshot completed successfully. Sep 23 15:19:09 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5f64e10a-ef4d-46a5-8da2-bb9a463e9cf9 tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-5fd1f51b-d83a-4420-a7f6-b601f2197e9e-delete_snapshot" released by "delete_snapshot" :: held 2.457s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fc9b9053-0fce-48a6-a00c-28673ca5348f tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fc9b9053-0fce-48a6-a00c-28673ca5348f tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fc9b9053-0fce-48a6-a00c-28673ca5348f tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-quobyte-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fc9b9053-0fce-48a6-a00c-28673ca5348f tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b" acquired by "delete_volume" :: waited 0.022s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:10 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f827bf7-a97b-4bf0-93c0-056a80679f32]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:19:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fc9b9053-0fce-48a6-a00c-28673ca5348f tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:10 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b Sep 23 15:19:10 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:10 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fc9b9053-0fce-48a6-a00c-28673ca5348f tempest-VolumesSnapshotTestJSON-320297079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b" returned: 0 in 0.450s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fc9b9053-0fce-48a6-a00c-28673ca5348f tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:10 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b Sep 23 15:19:10 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:11 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fc9b9053-0fce-48a6-a00c-28673ca5348f tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b" returned: 0 in 0.306s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Flow 'volume_create_manager' (3973fc69-7a78-4cea-9012-f4eaf27c2321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9440cf5-c264-4dd6-9e76-291c39dcf6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fc9b9053-0fce-48a6-a00c-28673ca5348f tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b" released by "delete_volume" :: held 0.882s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9440cf5-c264-4dd6-9e76-291c39dcf6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=451b7837-d625-425c-b8a8-426812b07ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe77c5227565472d8f3b4e066fbd70f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:19:11Z,use_quota=True,user_id='080b5f3598994d58905d8d77928899a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9120aa93-2512-4290-839b-acf05d54b381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9120aa93-2512-4290-839b-acf05d54b381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4742db2-a5f3-4b71-86d7-85c1fc570072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4742db2-a5f3-4b71-86d7-85c1fc570072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '451b7837-d625-425c-b8a8-426812b07ea1', 'volume_name': 'volume-451b7837-d625-425c-b8a8-426812b07ea1', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baec9842-2d9c-4d52-923c-65c20a9757fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baec9842-2d9c-4d52-923c-65c20a9757fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0980df0-8fd0-4af5-9f5c-902983c6cfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:11 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Volume 451b7837-d625-425c-b8a8-426812b07ea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-451b7837-d625-425c-b8a8-426812b07ea1', 'volume_size': 1} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=451b7837-d625-425c-b8a8-426812b07ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe77c5227565472d8f3b4e066fbd70f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:19:11Z,use_quota=True,user_id='080b5f3598994d58905d8d77928899a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Creating volume 451b7837-d625-425c-b8a8-426812b07ea1 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:19:11 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-451b7837-d625-425c-b8a8-426812b07ea1 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:11 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-451b7837-d625-425c-b8a8-426812b07ea1 1073741824 Sep 23 15:19:11 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-fc9b9053-0fce-48a6-a00c-28673ca5348f tempest-VolumesSnapshotTestJSON-320297079 None] Created reservations ['fb135165-5308-4ce5-ad32-b1b2386acfad', '387d8c00-b912-4e93-8ed7-09cfcbe8e1ba', '4d19a882-4f12-4534-9f4c-c6f160da5836', '33d4e70c-8293-4e94-a31d-bf551616f3c2'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fc9b9053-0fce-48a6-a00c-28673ca5348f tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fc9b9053-0fce-48a6-a00c-28673ca5348f tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fc9b9053-0fce-48a6-a00c-28673ca5348f tempest-VolumesSnapshotTestJSON-320297079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fc9b9053-0fce-48a6-a00c-28673ca5348f tempest-VolumesSnapshotTestJSON-320297079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fc9b9053-0fce-48a6-a00c-28673ca5348f tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fc9b9053-0fce-48a6-a00c-28673ca5348f tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:11 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:19:11 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:11 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fc9b9053-0fce-48a6-a00c-28673ca5348f tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.299s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fc9b9053-0fce-48a6-a00c-28673ca5348f tempest-VolumesSnapshotTestJSON-320297079 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:19:11 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-fc9b9053-0fce-48a6-a00c-28673ca5348f tempest-VolumesSnapshotTestJSON-320297079 None] Deleted volume successfully. Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-fc9b9053-0fce-48a6-a00c-28673ca5348f tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-b6e1a287-56bc-4e90-a63f-5a6e13a59a0b-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:11 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-451b7837-d625-425c-b8a8-426812b07ea1 1073741824" returned: 0 in 0.564s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-451b7837-d625-425c-b8a8-426812b07ea1 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:12 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-451b7837-d625-425c-b8a8-426812b07ea1 Sep 23 15:19:12 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:12 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-451b7837-d625-425c-b8a8-426812b07ea1" returned: 0 in 0.270s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:19:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0980df0-8fd0-4af5-9f5c-902983c6cfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-451b7837-d625-425c-b8a8-426812b07ea1', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a02e95-ef3e-488a-931a-2222b19a0845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:12 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Volume volume-451b7837-d625-425c-b8a8-426812b07ea1 (451b7837-d625-425c-b8a8-426812b07ea1): created successfully Sep 23 15:19:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a02e95-ef3e-488a-931a-2222b19a0845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Flow 'volume_create_manager' (3973fc69-7a78-4cea-9012-f4eaf27c2321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:19:12 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-c0a20cdf-2bbf-47ca-8f1b-7e64d494932f tempest-CinderUnicodeTest-1696595328 None] Created volume successfully. Sep 23 15:19:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c1d402ad-4c3e-4860-b69c-4a0fc6f73c7c tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-9d545c13-28e9-425a-82db-2d153bd6db27-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c1d402ad-4c3e-4860-b69c-4a0fc6f73c7c tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-9d545c13-28e9-425a-82db-2d153bd6db27-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c1d402ad-4c3e-4860-b69c-4a0fc6f73c7c tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "cinder-quobyte-9d545c13-28e9-425a-82db-2d153bd6db27" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c1d402ad-4c3e-4860-b69c-4a0fc6f73c7c tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-9d545c13-28e9-425a-82db-2d153bd6db27" acquired by "delete_volume" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:12 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[288f5b32-414d-4926-a4ff-8fea70c241b6]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:19:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c1d402ad-4c3e-4860-b69c-4a0fc6f73c7c tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:12 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27 Sep 23 15:19:12 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:13 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c1d402ad-4c3e-4860-b69c-4a0fc6f73c7c tempest-VolumesSnapshotTestJSON-320297079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27" returned: 0 in 0.384s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c1d402ad-4c3e-4860-b69c-4a0fc6f73c7c tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:13 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27 Sep 23 15:19:13 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:13 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c1d402ad-4c3e-4860-b69c-4a0fc6f73c7c tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9d545c13-28e9-425a-82db-2d153bd6db27" returned: 0 in 0.280s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c1d402ad-4c3e-4860-b69c-4a0fc6f73c7c tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-quobyte-9d545c13-28e9-425a-82db-2d153bd6db27" released by "delete_volume" :: held 0.735s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:13 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-c1d402ad-4c3e-4860-b69c-4a0fc6f73c7c tempest-VolumesSnapshotTestJSON-320297079 None] Created reservations ['a798176e-072e-4e03-a0bd-cba61a0dc74e', 'c8073e13-7f8a-4465-96fd-8ac28e8c5745', '92376cb5-5c0a-43bf-aac6-45f82749dd31', 'a2949960-5826-4021-8406-95b70dd837c7'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:19:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c1d402ad-4c3e-4860-b69c-4a0fc6f73c7c tempest-VolumesSnapshotTestJSON-320297079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c1d402ad-4c3e-4860-b69c-4a0fc6f73c7c tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c1d402ad-4c3e-4860-b69c-4a0fc6f73c7c tempest-VolumesSnapshotTestJSON-320297079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:19:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c1d402ad-4c3e-4860-b69c-4a0fc6f73c7c tempest-VolumesSnapshotTestJSON-320297079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:19:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c1d402ad-4c3e-4860-b69c-4a0fc6f73c7c tempest-VolumesSnapshotTestJSON-320297079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c1d402ad-4c3e-4860-b69c-4a0fc6f73c7c tempest-VolumesSnapshotTestJSON-320297079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:13 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:19:13 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:13 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:19:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Flow 'volume_create_manager' (652469c4-339b-4d75-a257-c5f481c1d5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:19:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fadf720f-1f4b-42dc-a331-02b1cd6cc915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fadf720f-1f4b-42dc-a331-02b1cd6cc915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:19:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1210810939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e82a07-8a88-4021-9236-827376401cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe77c5227565472d8f3b4e066fbd70f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:19:14Z,use_quota=True,user_id='080b5f3598994d58905d8d77928899a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5daa566c-35e3-4474-9a2c-950ed47b3086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5daa566c-35e3-4474-9a2c-950ed47b3086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86c1a0b-cd8f-48cc-bd28-42fa3651bd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86c1a0b-cd8f-48cc-bd28-42fa3651bd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30e82a07-8a88-4021-9236-827376401cb6', 'volume_name': 'volume-30e82a07-8a88-4021-9236-827376401cb6', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57de985-8913-4121-a3d0-0330d0ca41d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57de985-8913-4121-a3d0-0330d0ca41d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e783b5-75b2-4ece-9763-47ab144702c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:14 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Volume 30e82a07-8a88-4021-9236-827376401cb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30e82a07-8a88-4021-9236-827376401cb6', 'volume_size': 1} Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:19:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1210810939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e82a07-8a88-4021-9236-827376401cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe77c5227565472d8f3b4e066fbd70f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:19:14Z,use_quota=True,user_id='080b5f3598994d58905d8d77928899a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Creating volume 30e82a07-8a88-4021-9236-827376401cb6 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:19:14 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:19:14 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c1d402ad-4c3e-4860-b69c-4a0fc6f73c7c tempest-VolumesSnapshotTestJSON-320297079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.370s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-c1d402ad-4c3e-4860-b69c-4a0fc6f73c7c tempest-VolumesSnapshotTestJSON-320297079 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:19:14 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-c1d402ad-4c3e-4860-b69c-4a0fc6f73c7c tempest-VolumesSnapshotTestJSON-320297079 None] Deleted volume successfully. Sep 23 15:19:14 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6 1073741824 Sep 23 15:19:14 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c1d402ad-4c3e-4860-b69c-4a0fc6f73c7c tempest-VolumesSnapshotTestJSON-320297079 None] Lock "cinder-9d545c13-28e9-425a-82db-2d153bd6db27-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:14 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6 1073741824" returned: 0 in 0.548s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:14 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6 Sep 23 15:19:14 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:14 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6" returned: 0 in 0.330s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e783b5-75b2-4ece-9763-47ab144702c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e82a07-8a88-4021-9236-827376401cb6', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (590fb8d9-2006-4bd2-8e1a-870d595caccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:15 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Volume volume-30e82a07-8a88-4021-9236-827376401cb6 (30e82a07-8a88-4021-9236-827376401cb6): created successfully Sep 23 15:19:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (590fb8d9-2006-4bd2-8e1a-870d595caccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Flow 'volume_create_manager' (652469c4-339b-4d75-a257-c5f481c1d5ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:19:15 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-d85f145b-7529-439f-8df0-0198ed994120 tempest-CinderUnicodeTest-1696595328 None] Created volume successfully. Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Flow 'volume_create_manager' (c248c0fa-4dcd-446e-ad01-1b011cb6b061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e279a8-92e2-45eb-9ea7-d94a08f3be4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e279a8-92e2-45eb-9ea7-d94a08f3be4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-207650665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8cec197-54c3-4bfb-82a4-d5fb1c490033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a08fa2f6a62401c85709545d878ead5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:19:16Z,use_quota=True,user_id='1b069779cf554b1b8a0c733c6cf6c034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd675650-52c5-4983-86c7-ca28023cde68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd675650-52c5-4983-86c7-ca28023cde68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b244c74f-efbc-4d44-bd40-e800dd086ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b244c74f-efbc-4d44-bd40-e800dd086ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8cec197-54c3-4bfb-82a4-d5fb1c490033', 'volume_name': 'volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f246a9fc-af1f-42fd-861c-a1fb0acecad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f246a9fc-af1f-42fd-861c-a1fb0acecad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edfae4ce-be89-486d-8c5e-b948d00d2283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:16 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Volume e8cec197-54c3-4bfb-82a4-d5fb1c490033: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033', 'volume_size': 1} Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-207650665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8cec197-54c3-4bfb-82a4-d5fb1c490033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a08fa2f6a62401c85709545d878ead5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:19:16Z,use_quota=True,user_id='1b069779cf554b1b8a0c733c6cf6c034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Creating volume e8cec197-54c3-4bfb-82a4-d5fb1c490033 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:19:16 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:16 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033 1073741824 Sep 23 15:19:16 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a188e64d-517c-422c-81a4-028cd2641b42 tempest-CinderUnicodeTest-1696595328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:16 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033 1073741824" returned: 0 in 0.636s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:17 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033 Sep 23 15:19:17 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:17 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033" returned: 0 in 0.268s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:19:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a188e64d-517c-422c-81a4-028cd2641b42 tempest-CinderUnicodeTest-1696595328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.671s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edfae4ce-be89-486d-8c5e-b948d00d2283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba27ad57-4054-4455-8b73-0c75e294e021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-a188e64d-517c-422c-81a4-028cd2641b42 tempest-CinderUnicodeTest-1696595328 None] Creating offline snapshot 09e74733-4876-4d62-991b-e5cc36fa2842 of volume 30e82a07-8a88-4021-9236-827376401cb6 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:19:17 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Volume volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033 (e8cec197-54c3-4bfb-82a4-d5fb1c490033): created successfully Sep 23 15:19:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba27ad57-4054-4455-8b73-0c75e294e021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Flow 'volume_create_manager' (c248c0fa-4dcd-446e-ad01-1b011cb6b061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:19:17 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fca4ec-5a60-476f-9062-caab4c9c77af]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:19:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a188e64d-517c-422c-81a4-028cd2641b42 tempest-CinderUnicodeTest-1696595328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:17 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-43050817-74ce-4b2c-b3fa-ddac2d416cdd tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Created volume successfully. Sep 23 15:19:17 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6 Sep 23 15:19:17 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:17 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a188e64d-517c-422c-81a4-028cd2641b42 tempest-CinderUnicodeTest-1696595328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6" returned: 0 in 0.380s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a188e64d-517c-422c-81a4-028cd2641b42 tempest-CinderUnicodeTest-1696595328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.09e74733-4876-4d62-991b-e5cc36fa2842 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:17 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.09e74733-4876-4d62-991b-e5cc36fa2842 1G Sep 23 15:19:17 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:18 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a188e64d-517c-422c-81a4-028cd2641b42 tempest-CinderUnicodeTest-1696595328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.09e74733-4876-4d62-991b-e5cc36fa2842 1G" returned: 0 in 0.521s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a188e64d-517c-422c-81a4-028cd2641b42 tempest-CinderUnicodeTest-1696595328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30e82a07-8a88-4021-9236-827376401cb6 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.09e74733-4876-4d62-991b-e5cc36fa2842 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:18 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30e82a07-8a88-4021-9236-827376401cb6 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.09e74733-4876-4d62-991b-e5cc36fa2842 Sep 23 15:19:18 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-60e5f0bf-abb0-4f2b-9e87-74f54a5cc581 tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:18 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a188e64d-517c-422c-81a4-028cd2641b42 tempest-CinderUnicodeTest-1696595328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30e82a07-8a88-4021-9236-827376401cb6 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.09e74733-4876-4d62-991b-e5cc36fa2842" returned: 0 in 0.393s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:18 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-a188e64d-517c-422c-81a4-028cd2641b42 tempest-CinderUnicodeTest-1696595328 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.09e74733-4876-4d62-991b-e5cc36fa2842 is being set with open permissions: ugo+rw Sep 23 15:19:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a188e64d-517c-422c-81a4-028cd2641b42 tempest-CinderUnicodeTest-1696595328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.09e74733-4876-4d62-991b-e5cc36fa2842 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:18 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.09e74733-4876-4d62-991b-e5cc36fa2842 Sep 23 15:19:18 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:18 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a188e64d-517c-422c-81a4-028cd2641b42 tempest-CinderUnicodeTest-1696595328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.09e74733-4876-4d62-991b-e5cc36fa2842" returned: 0 in 0.273s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a188e64d-517c-422c-81a4-028cd2641b42 tempest-CinderUnicodeTest-1696595328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:18 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.info Sep 23 15:19:18 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:19 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a188e64d-517c-422c-81a4-028cd2641b42 tempest-CinderUnicodeTest-1696595328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.info" returned: 0 in 0.267s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:19 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-a188e64d-517c-422c-81a4-028cd2641b42 tempest-CinderUnicodeTest-1696595328 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.info is being set with open permissions: ugo+rw Sep 23 15:19:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a188e64d-517c-422c-81a4-028cd2641b42 tempest-CinderUnicodeTest-1696595328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:19 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.info Sep 23 15:19:19 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:19 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a188e64d-517c-422c-81a4-028cd2641b42 tempest-CinderUnicodeTest-1696595328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.info" returned: 0 in 0.291s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a188e64d-517c-422c-81a4-028cd2641b42 tempest-CinderUnicodeTest-1696595328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.256s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-60e5f0bf-abb0-4f2b-9e87-74f54a5cc581 tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.005s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-60e5f0bf-abb0-4f2b-9e87-74f54a5cc581 tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Creating offline snapshot d0ea0611-8ad9-41e2-95f9-daef4a8f7458 of volume e8cec197-54c3-4bfb-82a4-d5fb1c490033 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:19:19 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-a188e64d-517c-422c-81a4-028cd2641b42 tempest-CinderUnicodeTest-1696595328 None] Create snapshot completed successfully Sep 23 15:19:19 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13a6bfb-3bc7-4fb1-bb70-fa3025bdc109]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:19:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60e5f0bf-abb0-4f2b-9e87-74f54a5cc581 tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:19 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033 Sep 23 15:19:19 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6777bb7c-7b58-443e-bf7b-609eaeaccb44 tempest-CinderUnicodeTest-1696595328 None] Acquiring lock "cinder-09e74733-4876-4d62-991b-e5cc36fa2842-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6777bb7c-7b58-443e-bf7b-609eaeaccb44 tempest-CinderUnicodeTest-1696595328 None] Lock "cinder-09e74733-4876-4d62-991b-e5cc36fa2842-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6777bb7c-7b58-443e-bf7b-609eaeaccb44 tempest-CinderUnicodeTest-1696595328 None] Acquiring lock "cinder-quobyte-30e82a07-8a88-4021-9236-827376401cb6" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6777bb7c-7b58-443e-bf7b-609eaeaccb44 tempest-CinderUnicodeTest-1696595328 None] Lock "cinder-quobyte-30e82a07-8a88-4021-9236-827376401cb6" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6777bb7c-7b58-443e-bf7b-609eaeaccb44 tempest-CinderUnicodeTest-1696595328 None] Acquiring lock "cinder-quobyte-09e74733-4876-4d62-991b-e5cc36fa2842" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6777bb7c-7b58-443e-bf7b-609eaeaccb44 tempest-CinderUnicodeTest-1696595328 None] Lock "cinder-quobyte-09e74733-4876-4d62-991b-e5cc36fa2842" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-6777bb7c-7b58-443e-bf7b-609eaeaccb44 tempest-CinderUnicodeTest-1696595328 None] Deleting offline snapshot 09e74733-4876-4d62-991b-e5cc36fa2842 of volume 30e82a07-8a88-4021-9236-827376401cb6 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:19:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-6777bb7c-7b58-443e-bf7b-609eaeaccb44 tempest-CinderUnicodeTest-1696595328 None] snapshot_file for this snap is: volume-30e82a07-8a88-4021-9236-827376401cb6.09e74733-4876-4d62-991b-e5cc36fa2842 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:19:19 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0373d8d-e260-481f-b96a-a62b578e159e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:19:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6777bb7c-7b58-443e-bf7b-609eaeaccb44 tempest-CinderUnicodeTest-1696595328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.09e74733-4876-4d62-991b-e5cc36fa2842 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:20 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.09e74733-4876-4d62-991b-e5cc36fa2842 Sep 23 15:19:20 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60e5f0bf-abb0-4f2b-9e87-74f54a5cc581 tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033" returned: 0 in 0.545s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60e5f0bf-abb0-4f2b-9e87-74f54a5cc581 tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.d0ea0611-8ad9-41e2-95f9-daef4a8f7458 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:20 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:20 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.d0ea0611-8ad9-41e2-95f9-daef4a8f7458 1G Sep 23 15:19:20 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:20 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6777bb7c-7b58-443e-bf7b-609eaeaccb44 tempest-CinderUnicodeTest-1696595328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.09e74733-4876-4d62-991b-e5cc36fa2842" returned: 0 in 0.512s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-6777bb7c-7b58-443e-bf7b-609eaeaccb44 tempest-CinderUnicodeTest-1696595328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30e82a07-8a88-4021-9236-827376401cb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:19:20 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72a1791-18ec-4ab2-b833-1a76f78d47f6]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:19:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6777bb7c-7b58-443e-bf7b-609eaeaccb44 tempest-CinderUnicodeTest-1696595328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:20 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6 Sep 23 15:19:20 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:20 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60e5f0bf-abb0-4f2b-9e87-74f54a5cc581 tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.d0ea0611-8ad9-41e2-95f9-daef4a8f7458 1G" returned: 0 in 0.565s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60e5f0bf-abb0-4f2b-9e87-74f54a5cc581 tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.d0ea0611-8ad9-41e2-95f9-daef4a8f7458 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:20 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.d0ea0611-8ad9-41e2-95f9-daef4a8f7458 Sep 23 15:19:20 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:20 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6777bb7c-7b58-443e-bf7b-609eaeaccb44 tempest-CinderUnicodeTest-1696595328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6" returned: 0 in 0.501s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6777bb7c-7b58-443e-bf7b-609eaeaccb44 tempest-CinderUnicodeTest-1696595328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.09e74733-4876-4d62-991b-e5cc36fa2842 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:21 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.09e74733-4876-4d62-991b-e5cc36fa2842 Sep 23 15:19:21 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:21 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60e5f0bf-abb0-4f2b-9e87-74f54a5cc581 tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.d0ea0611-8ad9-41e2-95f9-daef4a8f7458" returned: 0 in 0.489s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:21 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-60e5f0bf-abb0-4f2b-9e87-74f54a5cc581 tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.d0ea0611-8ad9-41e2-95f9-daef4a8f7458 is being set with open permissions: ugo+rw Sep 23 15:19:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60e5f0bf-abb0-4f2b-9e87-74f54a5cc581 tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.d0ea0611-8ad9-41e2-95f9-daef4a8f7458 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:21 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.d0ea0611-8ad9-41e2-95f9-daef4a8f7458 Sep 23 15:19:21 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:21 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60e5f0bf-abb0-4f2b-9e87-74f54a5cc581 tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.d0ea0611-8ad9-41e2-95f9-daef4a8f7458" returned: 0 in 0.388s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60e5f0bf-abb0-4f2b-9e87-74f54a5cc581 tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:21 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.info Sep 23 15:19:21 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:21 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6777bb7c-7b58-443e-bf7b-609eaeaccb44 tempest-CinderUnicodeTest-1696595328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.09e74733-4876-4d62-991b-e5cc36fa2842" returned: 0 in 0.707s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6777bb7c-7b58-443e-bf7b-609eaeaccb44 tempest-CinderUnicodeTest-1696595328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.09e74733-4876-4d62-991b-e5cc36fa2842 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:21 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.09e74733-4876-4d62-991b-e5cc36fa2842 Sep 23 15:19:21 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:22 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60e5f0bf-abb0-4f2b-9e87-74f54a5cc581 tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.info" returned: 0 in 0.623s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:22 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-60e5f0bf-abb0-4f2b-9e87-74f54a5cc581 tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.info is being set with open permissions: ugo+rw Sep 23 15:19:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60e5f0bf-abb0-4f2b-9e87-74f54a5cc581 tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:22 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6777bb7c-7b58-443e-bf7b-609eaeaccb44 tempest-CinderUnicodeTest-1696595328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6.09e74733-4876-4d62-991b-e5cc36fa2842" returned: 0 in 0.615s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:22 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.info Sep 23 15:19:22 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6777bb7c-7b58-443e-bf7b-609eaeaccb44 tempest-CinderUnicodeTest-1696595328 None] Lock "cinder-quobyte-09e74733-4876-4d62-991b-e5cc36fa2842" released by "_delete_snapshot" :: held 2.542s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6777bb7c-7b58-443e-bf7b-609eaeaccb44 tempest-CinderUnicodeTest-1696595328 None] Lock "cinder-quobyte-30e82a07-8a88-4021-9236-827376401cb6" released by "delete_snapshot" :: held 2.589s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:22 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-6777bb7c-7b58-443e-bf7b-609eaeaccb44 tempest-CinderUnicodeTest-1696595328 None] Created reservations ['6c4596bc-11e4-4367-8ec0-66e5aacd9756', '98093cd4-32d9-449f-8f2b-109009327740', '18c72a4a-756a-4c15-8b33-e10c3429b128', '1e5d1f48-27b0-40d0-b695-3e5cdd14448e'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:19:22 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-6777bb7c-7b58-443e-bf7b-609eaeaccb44 tempest-CinderUnicodeTest-1696595328 None] Delete snapshot completed successfully. Sep 23 15:19:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6777bb7c-7b58-443e-bf7b-609eaeaccb44 tempest-CinderUnicodeTest-1696595328 None] Lock "cinder-09e74733-4876-4d62-991b-e5cc36fa2842-delete_snapshot" released by "delete_snapshot" :: held 2.804s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:22 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60e5f0bf-abb0-4f2b-9e87-74f54a5cc581 tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.info" returned: 0 in 0.402s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-60e5f0bf-abb0-4f2b-9e87-74f54a5cc581 tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.174s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:22 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-60e5f0bf-abb0-4f2b-9e87-74f54a5cc581 tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Create snapshot completed successfully Sep 23 15:19:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-39de1654-f464-48e8-9268-fb6922dcb0b8 tempest-CinderUnicodeTest-1696595328 None] Acquiring lock "cinder-30e82a07-8a88-4021-9236-827376401cb6-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-39de1654-f464-48e8-9268-fb6922dcb0b8 tempest-CinderUnicodeTest-1696595328 None] Lock "cinder-30e82a07-8a88-4021-9236-827376401cb6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-39de1654-f464-48e8-9268-fb6922dcb0b8 tempest-CinderUnicodeTest-1696595328 None] Acquiring lock "cinder-quobyte-30e82a07-8a88-4021-9236-827376401cb6" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-39de1654-f464-48e8-9268-fb6922dcb0b8 tempest-CinderUnicodeTest-1696595328 None] Lock "cinder-quobyte-30e82a07-8a88-4021-9236-827376401cb6" acquired by "delete_volume" :: waited 0.028s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:23 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e32b494-8170-46c4-a605-74308869d533]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:19:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-39de1654-f464-48e8-9268-fb6922dcb0b8 tempest-CinderUnicodeTest-1696595328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:23 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6 Sep 23 15:19:23 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:23 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-f741077c-345c-4049-b471-6845bfe39286 req-04a198d4-35db-4e9e-88bc-a1effe324778 tempest-TestShelveInstance-1752068730 None] Terminate volume connection completed successfully. Sep 23 15:19:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-f741077c-345c-4049-b471-6845bfe39286 req-04a198d4-35db-4e9e-88bc-a1effe324778 tempest-TestShelveInstance-1752068730 None] Deleting attachment 46c8218c-5b7c-4935-99a3-3982d83873c9. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:19:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-f741077c-345c-4049-b471-6845bfe39286 req-3f333830-3b3f-4878-b35c-f1648d24ea52 tempest-TestShelveInstance-1752068730 None] Acquiring lock "cinder-40a7bfba-448d-489b-abeb-d0dd97968257-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-f741077c-345c-4049-b471-6845bfe39286 req-3f333830-3b3f-4878-b35c-f1648d24ea52 tempest-TestShelveInstance-1752068730 None] Lock "cinder-40a7bfba-448d-489b-abeb-d0dd97968257-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-f741077c-345c-4049-b471-6845bfe39286 req-3f333830-3b3f-4878-b35c-f1648d24ea52 tempest-TestShelveInstance-1752068730 None] Acquiring lock "cinder-quobyte-40a7bfba-448d-489b-abeb-d0dd97968257" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-f741077c-345c-4049-b471-6845bfe39286 req-3f333830-3b3f-4878-b35c-f1648d24ea52 tempest-TestShelveInstance-1752068730 None] Lock "cinder-quobyte-40a7bfba-448d-489b-abeb-d0dd97968257" acquired by "delete_volume" :: waited 0.029s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:23 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-39de1654-f464-48e8-9268-fb6922dcb0b8 tempest-CinderUnicodeTest-1696595328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6" returned: 0 in 0.625s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-39de1654-f464-48e8-9268-fb6922dcb0b8 tempest-CinderUnicodeTest-1696595328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:23 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:19:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Flow 'volume_create_manager' (b7968612-0c80-4af9-89e4-fa944558afc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:19:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9685c381-238e-49ce-9ac5-63f18b7702e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:23 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2b6cdd-b498-44c8-8192-4b60af9fe756]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:19:23 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6 Sep 23 15:19:23 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-f741077c-345c-4049-b471-6845bfe39286 req-3f333830-3b3f-4878-b35c-f1648d24ea52 tempest-TestShelveInstance-1752068730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40a7bfba-448d-489b-abeb-d0dd97968257 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9685c381-238e-49ce-9ac5-63f18b7702e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1133071352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429498ff-8203-4598-8dfb-1465be4ddd3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5d11f503b384e179dc5b1f2710afae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:19:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:19:24Z,use_quota=True,user_id='7155d5207b364cc8b5f876229ed51e29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbc394a-5e54-4eae-b019-ec4899118cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbc394a-5e54-4eae-b019-ec4899118cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0463dd-2d86-4e1d-b727-edec37b5e7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0463dd-2d86-4e1d-b727-edec37b5e7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '429498ff-8203-4598-8dfb-1465be4ddd3f', 'volume_name': 'volume-429498ff-8203-4598-8dfb-1465be4ddd3f', 'volume_size': 2}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d5bf96-5b68-45ff-beb6-9d0f997a929f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d5bf96-5b68-45ff-beb6-9d0f997a929f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07273b47-19ce-4ff4-bd23-900789a519f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:24 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Volume 429498ff-8203-4598-8dfb-1465be4ddd3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-429498ff-8203-4598-8dfb-1465be4ddd3f', 'volume_size': 2} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1133071352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429498ff-8203-4598-8dfb-1465be4ddd3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5d11f503b384e179dc5b1f2710afae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:19:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:19:24Z,use_quota=True,user_id='7155d5207b364cc8b5f876229ed51e29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Creating volume 429498ff-8203-4598-8dfb-1465be4ddd3f {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:19:24 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f 2147483648 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:24 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40a7bfba-448d-489b-abeb-d0dd97968257 Sep 23 15:19:24 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:24 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f 2147483648 Sep 23 15:19:24 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:24 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-39de1654-f464-48e8-9268-fb6922dcb0b8 tempest-CinderUnicodeTest-1696595328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e82a07-8a88-4021-9236-827376401cb6" returned: 0 in 0.538s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:24 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-f741077c-345c-4049-b471-6845bfe39286 req-3f333830-3b3f-4878-b35c-f1648d24ea52 tempest-TestShelveInstance-1752068730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40a7bfba-448d-489b-abeb-d0dd97968257" returned: 0 in 0.499s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-f741077c-345c-4049-b471-6845bfe39286 req-3f333830-3b3f-4878-b35c-f1648d24ea52 tempest-TestShelveInstance-1752068730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40a7bfba-448d-489b-abeb-d0dd97968257 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-39de1654-f464-48e8-9268-fb6922dcb0b8 tempest-CinderUnicodeTest-1696595328 None] Lock "cinder-quobyte-30e82a07-8a88-4021-9236-827376401cb6" released by "delete_volume" :: held 1.276s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:24 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40a7bfba-448d-489b-abeb-d0dd97968257 Sep 23 15:19:24 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-39de1654-f464-48e8-9268-fb6922dcb0b8 tempest-CinderUnicodeTest-1696595328 None] Created reservations ['87f361de-ab8d-428f-967d-1a94760eda3b', '48818211-0233-4b02-9caa-c739c85d3b17', 'c0a09ee6-f9b1-4c73-9968-231c53d873aa', '6e3c33d0-1b9a-46d9-b982-db954e26cc00'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b77f5772-bbb2-4504-ab87-59a45aa82a0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Acquiring lock "cinder-d0ea0611-8ad9-41e2-95f9-daef4a8f7458-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b77f5772-bbb2-4504-ab87-59a45aa82a0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Lock "cinder-d0ea0611-8ad9-41e2-95f9-daef4a8f7458-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b77f5772-bbb2-4504-ab87-59a45aa82a0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Acquiring lock "cinder-quobyte-e8cec197-54c3-4bfb-82a4-d5fb1c490033" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b77f5772-bbb2-4504-ab87-59a45aa82a0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Lock "cinder-quobyte-e8cec197-54c3-4bfb-82a4-d5fb1c490033" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b77f5772-bbb2-4504-ab87-59a45aa82a0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Acquiring lock "cinder-quobyte-d0ea0611-8ad9-41e2-95f9-daef4a8f7458" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b77f5772-bbb2-4504-ab87-59a45aa82a0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Lock "cinder-quobyte-d0ea0611-8ad9-41e2-95f9-daef4a8f7458" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-b77f5772-bbb2-4504-ab87-59a45aa82a0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Deleting offline snapshot d0ea0611-8ad9-41e2-95f9-daef4a8f7458 of volume e8cec197-54c3-4bfb-82a4-d5fb1c490033 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-b77f5772-bbb2-4504-ab87-59a45aa82a0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] snapshot_file for this snap is: volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.d0ea0611-8ad9-41e2-95f9-daef4a8f7458 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-39de1654-f464-48e8-9268-fb6922dcb0b8 tempest-CinderUnicodeTest-1696595328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-39de1654-f464-48e8-9268-fb6922dcb0b8 tempest-CinderUnicodeTest-1696595328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-39de1654-f464-48e8-9268-fb6922dcb0b8 tempest-CinderUnicodeTest-1696595328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-39de1654-f464-48e8-9268-fb6922dcb0b8 tempest-CinderUnicodeTest-1696595328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-39de1654-f464-48e8-9268-fb6922dcb0b8 tempest-CinderUnicodeTest-1696595328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-39de1654-f464-48e8-9268-fb6922dcb0b8 tempest-CinderUnicodeTest-1696595328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ebadc7-1e78-46cf-a86d-248410a4553c]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b77f5772-bbb2-4504-ab87-59a45aa82a0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.d0ea0611-8ad9-41e2-95f9-daef4a8f7458 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:24 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:19:24 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:24 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-f741077c-345c-4049-b471-6845bfe39286 req-3f333830-3b3f-4878-b35c-f1648d24ea52 tempest-TestShelveInstance-1752068730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-40a7bfba-448d-489b-abeb-d0dd97968257" returned: 0 in 0.446s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:24 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f 2147483648" returned: 0 in 0.856s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-f741077c-345c-4049-b471-6845bfe39286 req-3f333830-3b3f-4878-b35c-f1648d24ea52 tempest-TestShelveInstance-1752068730 None] Lock "cinder-quobyte-40a7bfba-448d-489b-abeb-d0dd97968257" released by "delete_volume" :: held 1.077s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:24 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.d0ea0611-8ad9-41e2-95f9-daef4a8f7458 Sep 23 15:19:24 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:25 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f Sep 23 15:19:25 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG cinder.quota [req-f741077c-345c-4049-b471-6845bfe39286 req-3f333830-3b3f-4878-b35c-f1648d24ea52 tempest-TestShelveInstance-1752068730 None] Created reservations ['5264af99-9ce1-406b-a082-821183d3b905', '44ed0ede-fcb7-41c9-bb70-cdebdb8cd043', '85912f5f-8276-486b-a839-99f2e070e498', '294ce57e-9d3d-46f7-8564-ea963003f9fe'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:19:25 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-39de1654-f464-48e8-9268-fb6922dcb0b8 tempest-CinderUnicodeTest-1696595328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.328s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-39de1654-f464-48e8-9268-fb6922dcb0b8 tempest-CinderUnicodeTest-1696595328 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:19:25 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-39de1654-f464-48e8-9268-fb6922dcb0b8 tempest-CinderUnicodeTest-1696595328 None] Deleted volume successfully. Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-39de1654-f464-48e8-9268-fb6922dcb0b8 tempest-CinderUnicodeTest-1696595328 None] Lock "cinder-30e82a07-8a88-4021-9236-827376401cb6-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-f741077c-345c-4049-b471-6845bfe39286 req-3f333830-3b3f-4878-b35c-f1648d24ea52 tempest-TestShelveInstance-1752068730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-f741077c-345c-4049-b471-6845bfe39286 req-3f333830-3b3f-4878-b35c-f1648d24ea52 tempest-TestShelveInstance-1752068730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [req-f741077c-345c-4049-b471-6845bfe39286 req-3f333830-3b3f-4878-b35c-f1648d24ea52 tempest-TestShelveInstance-1752068730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [req-f741077c-345c-4049-b471-6845bfe39286 req-3f333830-3b3f-4878-b35c-f1648d24ea52 tempest-TestShelveInstance-1752068730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-f741077c-345c-4049-b471-6845bfe39286 req-3f333830-3b3f-4878-b35c-f1648d24ea52 tempest-TestShelveInstance-1752068730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-f741077c-345c-4049-b471-6845bfe39286 req-3f333830-3b3f-4878-b35c-f1648d24ea52 tempest-TestShelveInstance-1752068730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:25 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:19:25 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:25 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b77f5772-bbb2-4504-ab87-59a45aa82a0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.d0ea0611-8ad9-41e2-95f9-daef4a8f7458" returned: 0 in 0.630s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-b77f5772-bbb2-4504-ab87-59a45aa82a0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-62ec964c-f63f-4f4f-a997-3a9f2cbd0dc3 tempest-CinderUnicodeTest-1696595328 None] Acquiring lock "cinder-451b7837-d625-425c-b8a8-426812b07ea1-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed57a4a2-b894-4d12-bfcf-3af135e3c019]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b77f5772-bbb2-4504-ab87-59a45aa82a0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:25 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f" returned: 0 in 0.497s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-62ec964c-f63f-4f4f-a997-3a9f2cbd0dc3 tempest-CinderUnicodeTest-1696595328 None] Lock "cinder-451b7837-d625-425c-b8a8-426812b07ea1-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:25 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07273b47-19ce-4ff4-bd23-900789a519f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-429498ff-8203-4598-8dfb-1465be4ddd3f', 'volume_size': 2}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70862abc-0799-4147-85b8-7b436dccc445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [req-f741077c-345c-4049-b471-6845bfe39286 req-3f333830-3b3f-4878-b35c-f1648d24ea52 tempest-TestShelveInstance-1752068730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.348s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG cinder.manager [req-f741077c-345c-4049-b471-6845bfe39286 req-3f333830-3b3f-4878-b35c-f1648d24ea52 tempest-TestShelveInstance-1752068730 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:19:25 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Volume volume-429498ff-8203-4598-8dfb-1465be4ddd3f (429498ff-8203-4598-8dfb-1465be4ddd3f): created successfully Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70862abc-0799-4147-85b8-7b436dccc445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Flow 'volume_create_manager' (b7968612-0c80-4af9-89e4-fa944558afc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:19:25 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-f741077c-345c-4049-b471-6845bfe39286 req-3f333830-3b3f-4878-b35c-f1648d24ea52 tempest-TestShelveInstance-1752068730 None] Deleted volume successfully. Sep 23 15:19:25 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-cb87126b-9284-4af1-93bb-b2eb3ff0c47a tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Created volume successfully. Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-62ec964c-f63f-4f4f-a997-3a9f2cbd0dc3 tempest-CinderUnicodeTest-1696595328 None] Acquiring lock "cinder-quobyte-451b7837-d625-425c-b8a8-426812b07ea1" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG cinder.coordination [req-f741077c-345c-4049-b471-6845bfe39286 req-3f333830-3b3f-4878-b35c-f1648d24ea52 tempest-TestShelveInstance-1752068730 None] Lock "cinder-40a7bfba-448d-489b-abeb-d0dd97968257-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-62ec964c-f63f-4f4f-a997-3a9f2cbd0dc3 tempest-CinderUnicodeTest-1696595328 None] Lock "cinder-quobyte-451b7837-d625-425c-b8a8-426812b07ea1" acquired by "delete_volume" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:25 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033 Sep 23 15:19:25 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97babb4-a1da-42d0-9cc7-c7ad4f6d4bd7]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-62ec964c-f63f-4f4f-a997-3a9f2cbd0dc3 tempest-CinderUnicodeTest-1696595328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-451b7837-d625-425c-b8a8-426812b07ea1 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:25 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-451b7837-d625-425c-b8a8-426812b07ea1 Sep 23 15:19:25 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:25 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b77f5772-bbb2-4504-ab87-59a45aa82a0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033" returned: 0 in 0.515s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b77f5772-bbb2-4504-ab87-59a45aa82a0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.d0ea0611-8ad9-41e2-95f9-daef4a8f7458 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:26 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.d0ea0611-8ad9-41e2-95f9-daef4a8f7458 Sep 23 15:19:26 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:26 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-62ec964c-f63f-4f4f-a997-3a9f2cbd0dc3 tempest-CinderUnicodeTest-1696595328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-451b7837-d625-425c-b8a8-426812b07ea1" returned: 0 in 0.437s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-62ec964c-f63f-4f4f-a997-3a9f2cbd0dc3 tempest-CinderUnicodeTest-1696595328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-451b7837-d625-425c-b8a8-426812b07ea1 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:26 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-451b7837-d625-425c-b8a8-426812b07ea1 Sep 23 15:19:26 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-11ba18cf-a46d-4767-8810-cc42fe786761 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-11ba18cf-a46d-4767-8810-cc42fe786761 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-11ba18cf-a46d-4767-8810-cc42fe786761 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Creating offline snapshot c40a66bd-ca63-426b-ab24-a3e5a7a7d14c of volume 429498ff-8203-4598-8dfb-1465be4ddd3f {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edbcb56-854b-43cc-ac43-74f3c0fd66c0]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-11ba18cf-a46d-4767-8810-cc42fe786761 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:26 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f Sep 23 15:19:26 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:26 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b77f5772-bbb2-4504-ab87-59a45aa82a0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.d0ea0611-8ad9-41e2-95f9-daef4a8f7458" returned: 0 in 0.493s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b77f5772-bbb2-4504-ab87-59a45aa82a0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.d0ea0611-8ad9-41e2-95f9-daef4a8f7458 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:26 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-62ec964c-f63f-4f4f-a997-3a9f2cbd0dc3 tempest-CinderUnicodeTest-1696595328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-451b7837-d625-425c-b8a8-426812b07ea1" returned: 0 in 0.402s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:26 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.d0ea0611-8ad9-41e2-95f9-daef4a8f7458 Sep 23 15:19:26 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-62ec964c-f63f-4f4f-a997-3a9f2cbd0dc3 tempest-CinderUnicodeTest-1696595328 None] Lock "cinder-quobyte-451b7837-d625-425c-b8a8-426812b07ea1" released by "delete_volume" :: held 0.898s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-62ec964c-f63f-4f4f-a997-3a9f2cbd0dc3 tempest-CinderUnicodeTest-1696595328 None] Created reservations ['7fa664f0-df7f-4a25-9ab9-babb49500115', '2ba66c08-f47e-4ce3-92e4-9715c000a450', '38f83c8a-a146-449c-8a60-bd5aad544154', 'be629359-ef80-4847-9a29-fd4d75dfdbed'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-62ec964c-f63f-4f4f-a997-3a9f2cbd0dc3 tempest-CinderUnicodeTest-1696595328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-62ec964c-f63f-4f4f-a997-3a9f2cbd0dc3 tempest-CinderUnicodeTest-1696595328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-62ec964c-f63f-4f4f-a997-3a9f2cbd0dc3 tempest-CinderUnicodeTest-1696595328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-62ec964c-f63f-4f4f-a997-3a9f2cbd0dc3 tempest-CinderUnicodeTest-1696595328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-62ec964c-f63f-4f4f-a997-3a9f2cbd0dc3 tempest-CinderUnicodeTest-1696595328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-62ec964c-f63f-4f4f-a997-3a9f2cbd0dc3 tempest-CinderUnicodeTest-1696595328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:26 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:19:26 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:26 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-11ba18cf-a46d-4767-8810-cc42fe786761 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f" returned: 0 in 0.460s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-11ba18cf-a46d-4767-8810-cc42fe786761 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.c40a66bd-ca63-426b-ab24-a3e5a7a7d14c 2G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:26 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.c40a66bd-ca63-426b-ab24-a3e5a7a7d14c 2G Sep 23 15:19:26 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:26 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b77f5772-bbb2-4504-ab87-59a45aa82a0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033.d0ea0611-8ad9-41e2-95f9-daef4a8f7458" returned: 0 in 0.378s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b77f5772-bbb2-4504-ab87-59a45aa82a0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Lock "cinder-quobyte-d0ea0611-8ad9-41e2-95f9-daef4a8f7458" released by "_delete_snapshot" :: held 2.191s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:26 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b77f5772-bbb2-4504-ab87-59a45aa82a0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Lock "cinder-quobyte-e8cec197-54c3-4bfb-82a4-d5fb1c490033" released by "delete_snapshot" :: held 2.245s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:27 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-b77f5772-bbb2-4504-ab87-59a45aa82a0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Created reservations ['2b6527d6-1c7d-4a7b-b2a8-d4ef03af43a1', '6c75888d-7fd3-4418-ba25-37224e2465b6', '686e86cf-95eb-47e7-a954-8a61397fd194', '4d8cfe19-0b3b-4acb-9860-8c0a588fdbec'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:19:27 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-62ec964c-f63f-4f4f-a997-3a9f2cbd0dc3 tempest-CinderUnicodeTest-1696595328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.270s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:27 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-62ec964c-f63f-4f4f-a997-3a9f2cbd0dc3 tempest-CinderUnicodeTest-1696595328 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:19:27 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-62ec964c-f63f-4f4f-a997-3a9f2cbd0dc3 tempest-CinderUnicodeTest-1696595328 None] Deleted volume successfully. Sep 23 15:19:27 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-62ec964c-f63f-4f4f-a997-3a9f2cbd0dc3 tempest-CinderUnicodeTest-1696595328 None] Lock "cinder-451b7837-d625-425c-b8a8-426812b07ea1-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:27 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-b77f5772-bbb2-4504-ab87-59a45aa82a0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Delete snapshot completed successfully. Sep 23 15:19:27 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b77f5772-bbb2-4504-ab87-59a45aa82a0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Lock "cinder-d0ea0611-8ad9-41e2-95f9-daef4a8f7458-delete_snapshot" released by "delete_snapshot" :: held 2.449s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:27 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-11ba18cf-a46d-4767-8810-cc42fe786761 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.c40a66bd-ca63-426b-ab24-a3e5a7a7d14c 2G" returned: 0 in 0.534s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-11ba18cf-a46d-4767-8810-cc42fe786761 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-429498ff-8203-4598-8dfb-1465be4ddd3f -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.c40a66bd-ca63-426b-ab24-a3e5a7a7d14c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:27 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-429498ff-8203-4598-8dfb-1465be4ddd3f -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.c40a66bd-ca63-426b-ab24-a3e5a7a7d14c Sep 23 15:19:27 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:27 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-11ba18cf-a46d-4767-8810-cc42fe786761 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-429498ff-8203-4598-8dfb-1465be4ddd3f -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.c40a66bd-ca63-426b-ab24-a3e5a7a7d14c" returned: 0 in 0.305s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:27 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-11ba18cf-a46d-4767-8810-cc42fe786761 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.c40a66bd-ca63-426b-ab24-a3e5a7a7d14c is being set with open permissions: ugo+rw Sep 23 15:19:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-11ba18cf-a46d-4767-8810-cc42fe786761 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.c40a66bd-ca63-426b-ab24-a3e5a7a7d14c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:27 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.c40a66bd-ca63-426b-ab24-a3e5a7a7d14c Sep 23 15:19:27 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:27 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-725b1382-2a82-4a14-a2f3-20e3d10c819b tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Acquiring lock "cinder-e8cec197-54c3-4bfb-82a4-d5fb1c490033-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:27 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:27 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-725b1382-2a82-4a14-a2f3-20e3d10c819b tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Lock "cinder-e8cec197-54c3-4bfb-82a4-d5fb1c490033-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-11ba18cf-a46d-4767-8810-cc42fe786761 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.c40a66bd-ca63-426b-ab24-a3e5a7a7d14c" returned: 0 in 0.326s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-725b1382-2a82-4a14-a2f3-20e3d10c819b tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Acquiring lock "cinder-quobyte-e8cec197-54c3-4bfb-82a4-d5fb1c490033" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-11ba18cf-a46d-4767-8810-cc42fe786761 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-725b1382-2a82-4a14-a2f3-20e3d10c819b tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Lock "cinder-quobyte-e8cec197-54c3-4bfb-82a4-d5fb1c490033" acquired by "delete_volume" :: waited 0.049s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:28 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.info Sep 23 15:19:28 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:28 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f957da-e68e-419e-94ae-7f6b0d347c7a]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:19:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-725b1382-2a82-4a14-a2f3-20e3d10c819b tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:28 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033 Sep 23 15:19:28 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:28 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-11ba18cf-a46d-4767-8810-cc42fe786761 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.info" returned: 0 in 0.466s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:28 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-11ba18cf-a46d-4767-8810-cc42fe786761 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.info is being set with open permissions: ugo+rw Sep 23 15:19:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-11ba18cf-a46d-4767-8810-cc42fe786761 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:28 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.info Sep 23 15:19:28 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:28 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-725b1382-2a82-4a14-a2f3-20e3d10c819b tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033" returned: 0 in 0.516s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-725b1382-2a82-4a14-a2f3-20e3d10c819b tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:28 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033 Sep 23 15:19:28 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:28 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-11ba18cf-a46d-4767-8810-cc42fe786761 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.info" returned: 0 in 0.297s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-11ba18cf-a46d-4767-8810-cc42fe786761 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.531s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:28 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-11ba18cf-a46d-4767-8810-cc42fe786761 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Create snapshot completed successfully Sep 23 15:19:28 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-725b1382-2a82-4a14-a2f3-20e3d10c819b tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e8cec197-54c3-4bfb-82a4-d5fb1c490033" returned: 0 in 0.277s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-725b1382-2a82-4a14-a2f3-20e3d10c819b tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Lock "cinder-quobyte-e8cec197-54c3-4bfb-82a4-d5fb1c490033" released by "delete_volume" :: held 0.884s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:29 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-725b1382-2a82-4a14-a2f3-20e3d10c819b tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Created reservations ['f740c221-4a5b-4ba7-8d9e-9be400bd2ee6', '77d59c89-5728-4902-9976-622c86b7e6a4', 'c546c812-e63a-4e9c-8de0-040a3cc0ccb6', '72dd1155-f448-4ba7-9367-e048a103a280'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:19:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-725b1382-2a82-4a14-a2f3-20e3d10c819b tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-725b1382-2a82-4a14-a2f3-20e3d10c819b tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-725b1382-2a82-4a14-a2f3-20e3d10c819b tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:19:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-725b1382-2a82-4a14-a2f3-20e3d10c819b tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:19:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-725b1382-2a82-4a14-a2f3-20e3d10c819b tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-725b1382-2a82-4a14-a2f3-20e3d10c819b tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:29 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:19:29 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:29 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-725b1382-2a82-4a14-a2f3-20e3d10c819b tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.352s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:29 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-725b1382-2a82-4a14-a2f3-20e3d10c819b tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:19:29 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-725b1382-2a82-4a14-a2f3-20e3d10c819b tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Deleted volume successfully. Sep 23 15:19:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-725b1382-2a82-4a14-a2f3-20e3d10c819b tempest-VolumeSnapshotQuotasNegativeTestJSON-1115414175 None] Lock "cinder-e8cec197-54c3-4bfb-82a4-d5fb1c490033-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-79ac7b9c-120e-46cc-aae1-8622572d88a0 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Acquiring lock "cinder-c40a66bd-ca63-426b-ab24-a3e5a7a7d14c-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-79ac7b9c-120e-46cc-aae1-8622572d88a0 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Lock "cinder-c40a66bd-ca63-426b-ab24-a3e5a7a7d14c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-79ac7b9c-120e-46cc-aae1-8622572d88a0 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Acquiring lock "cinder-quobyte-429498ff-8203-4598-8dfb-1465be4ddd3f" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-79ac7b9c-120e-46cc-aae1-8622572d88a0 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Lock "cinder-quobyte-429498ff-8203-4598-8dfb-1465be4ddd3f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-79ac7b9c-120e-46cc-aae1-8622572d88a0 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Acquiring lock "cinder-quobyte-c40a66bd-ca63-426b-ab24-a3e5a7a7d14c" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-79ac7b9c-120e-46cc-aae1-8622572d88a0 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Lock "cinder-quobyte-c40a66bd-ca63-426b-ab24-a3e5a7a7d14c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-79ac7b9c-120e-46cc-aae1-8622572d88a0 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Deleting offline snapshot c40a66bd-ca63-426b-ab24-a3e5a7a7d14c of volume 429498ff-8203-4598-8dfb-1465be4ddd3f {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:19:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-79ac7b9c-120e-46cc-aae1-8622572d88a0 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] snapshot_file for this snap is: volume-429498ff-8203-4598-8dfb-1465be4ddd3f.c40a66bd-ca63-426b-ab24-a3e5a7a7d14c {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:19:29 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af155af-70a7-43e9-8317-fc0d43965826]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:19:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79ac7b9c-120e-46cc-aae1-8622572d88a0 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.c40a66bd-ca63-426b-ab24-a3e5a7a7d14c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:29 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.c40a66bd-ca63-426b-ab24-a3e5a7a7d14c Sep 23 15:19:29 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:30 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79ac7b9c-120e-46cc-aae1-8622572d88a0 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.c40a66bd-ca63-426b-ab24-a3e5a7a7d14c" returned: 0 in 0.392s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-79ac7b9c-120e-46cc-aae1-8622572d88a0 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-429498ff-8203-4598-8dfb-1465be4ddd3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:19:30 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3835bd-46e7-4e92-9cbc-5513e69167d3]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:19:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79ac7b9c-120e-46cc-aae1-8622572d88a0 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:30 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f Sep 23 15:19:30 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:30 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79ac7b9c-120e-46cc-aae1-8622572d88a0 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f" returned: 0 in 0.552s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79ac7b9c-120e-46cc-aae1-8622572d88a0 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.c40a66bd-ca63-426b-ab24-a3e5a7a7d14c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:30 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.c40a66bd-ca63-426b-ab24-a3e5a7a7d14c Sep 23 15:19:30 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:31 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79ac7b9c-120e-46cc-aae1-8622572d88a0 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.c40a66bd-ca63-426b-ab24-a3e5a7a7d14c" returned: 0 in 0.461s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79ac7b9c-120e-46cc-aae1-8622572d88a0 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.c40a66bd-ca63-426b-ab24-a3e5a7a7d14c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:31 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.c40a66bd-ca63-426b-ab24-a3e5a7a7d14c Sep 23 15:19:31 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:31 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79ac7b9c-120e-46cc-aae1-8622572d88a0 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f.c40a66bd-ca63-426b-ab24-a3e5a7a7d14c" returned: 0 in 0.333s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-79ac7b9c-120e-46cc-aae1-8622572d88a0 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Lock "cinder-quobyte-c40a66bd-ca63-426b-ab24-a3e5a7a7d14c" released by "_delete_snapshot" :: held 1.885s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-79ac7b9c-120e-46cc-aae1-8622572d88a0 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Lock "cinder-quobyte-429498ff-8203-4598-8dfb-1465be4ddd3f" released by "delete_snapshot" :: held 1.921s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:31 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-79ac7b9c-120e-46cc-aae1-8622572d88a0 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Created reservations ['b5776c8f-9827-447c-b737-0a65ce91d454', '75e0ea71-c35b-4728-92de-40e90e392624', 'e1734024-030d-4cac-b9ed-a002756a8415', '9d8de3d0-07b5-4da6-806e-0fc930795464'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:19:31 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-79ac7b9c-120e-46cc-aae1-8622572d88a0 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Delete snapshot completed successfully. Sep 23 15:19:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-79ac7b9c-120e-46cc-aae1-8622572d88a0 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Lock "cinder-c40a66bd-ca63-426b-ab24-a3e5a7a7d14c-delete_snapshot" released by "delete_snapshot" :: held 2.120s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-567c9bd7-1131-4b49-9be5-a65e9a79ace9 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Acquiring lock "cinder-429498ff-8203-4598-8dfb-1465be4ddd3f-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-567c9bd7-1131-4b49-9be5-a65e9a79ace9 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Lock "cinder-429498ff-8203-4598-8dfb-1465be4ddd3f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-567c9bd7-1131-4b49-9be5-a65e9a79ace9 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Acquiring lock "cinder-quobyte-429498ff-8203-4598-8dfb-1465be4ddd3f" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-567c9bd7-1131-4b49-9be5-a65e9a79ace9 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Lock "cinder-quobyte-429498ff-8203-4598-8dfb-1465be4ddd3f" acquired by "delete_volume" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:32 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a41190-1852-4c40-914f-14aab5b7a6cc]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:19:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-567c9bd7-1131-4b49-9be5-a65e9a79ace9 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:32 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f Sep 23 15:19:32 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:32 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-567c9bd7-1131-4b49-9be5-a65e9a79ace9 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f" returned: 0 in 0.513s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-567c9bd7-1131-4b49-9be5-a65e9a79ace9 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:32 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f Sep 23 15:19:32 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:32 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:19:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Flow 'volume_create_manager' (d2b4985b-52b2-411e-a27a-e9c632d37acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:19:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e96e7e-d203-464a-ba45-f746d4b27bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e96e7e-d203-464a-ba45-f746d4b27bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1938560384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e757404a-47a2-43af-a40f-0945985f07a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a899cdfbf59d4fc3ae670440b4d8e367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:19:33Z,use_quota=True,user_id='42f79a8c76d9416382f3de6f010deb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:33 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41e72621-9e6e-4533-9c4a-902957a5146f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41e72621-9e6e-4533-9c4a-902957a5146f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e990e5f-2026-4ef8-8c14-40863bb2a049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e990e5f-2026-4ef8-8c14-40863bb2a049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e757404a-47a2-43af-a40f-0945985f07a4', 'volume_name': 'volume-e757404a-47a2-43af-a40f-0945985f07a4', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13bf9e96-2fb0-48d4-8961-503a47378616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13bf9e96-2fb0-48d4-8961-503a47378616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b0a3d0-8478-4b5c-9975-5a4f5291f191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:33 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Volume e757404a-47a2-43af-a40f-0945985f07a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e757404a-47a2-43af-a40f-0945985f07a4', 'volume_size': 1} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1938560384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e757404a-47a2-43af-a40f-0945985f07a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a899cdfbf59d4fc3ae670440b4d8e367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:19:33Z,use_quota=True,user_id='42f79a8c76d9416382f3de6f010deb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Creating volume e757404a-47a2-43af-a40f-0945985f07a4 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:19:33 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e757404a-47a2-43af-a40f-0945985f07a4 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-567c9bd7-1131-4b49-9be5-a65e9a79ace9 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-429498ff-8203-4598-8dfb-1465be4ddd3f" returned: 0 in 0.527s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:33 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e757404a-47a2-43af-a40f-0945985f07a4 1073741824 Sep 23 15:19:33 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-567c9bd7-1131-4b49-9be5-a65e9a79ace9 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Lock "cinder-quobyte-429498ff-8203-4598-8dfb-1465be4ddd3f" released by "delete_volume" :: held 1.143s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-567c9bd7-1131-4b49-9be5-a65e9a79ace9 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Created reservations ['457b96b3-fdf6-443e-8b34-e41c3e63dd64', 'd5387056-3e42-44d3-81d9-592d2fb7af1f', '72d0c776-a55c-4426-a1c4-d5a1c09b2ff6', '26c4e829-0920-433c-9980-7e7074d0b839'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-567c9bd7-1131-4b49-9be5-a65e9a79ace9 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-567c9bd7-1131-4b49-9be5-a65e9a79ace9 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-567c9bd7-1131-4b49-9be5-a65e9a79ace9 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-567c9bd7-1131-4b49-9be5-a65e9a79ace9 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-567c9bd7-1131-4b49-9be5-a65e9a79ace9 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-567c9bd7-1131-4b49-9be5-a65e9a79ace9 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:33 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:19:33 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:33 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e757404a-47a2-43af-a40f-0945985f07a4 1073741824" returned: 0 in 0.579s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e757404a-47a2-43af-a40f-0945985f07a4 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:33 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-567c9bd7-1131-4b49-9be5-a65e9a79ace9 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.339s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-567c9bd7-1131-4b49-9be5-a65e9a79ace9 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:19:33 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-567c9bd7-1131-4b49-9be5-a65e9a79ace9 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Deleted volume successfully. Sep 23 15:19:33 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e757404a-47a2-43af-a40f-0945985f07a4 Sep 23 15:19:33 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-567c9bd7-1131-4b49-9be5-a65e9a79ace9 tempest-VolumesSnapshotNegativeTestJSON-641799712 None] Lock "cinder-429498ff-8203-4598-8dfb-1465be4ddd3f-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:34 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e757404a-47a2-43af-a40f-0945985f07a4" returned: 0 in 0.292s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:19:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b0a3d0-8478-4b5c-9975-5a4f5291f191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e757404a-47a2-43af-a40f-0945985f07a4', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c43ae0f5-49d0-49b1-8a73-3181afe32b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:34 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Volume volume-e757404a-47a2-43af-a40f-0945985f07a4 (e757404a-47a2-43af-a40f-0945985f07a4): created successfully Sep 23 15:19:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c43ae0f5-49d0-49b1-8a73-3181afe32b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Flow 'volume_create_manager' (d2b4985b-52b2-411e-a27a-e9c632d37acc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:19:34 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-c9c3321b-0e5e-4721-8937-f018edafcf46 tempest-ProjectReaderTests-768611755 None] Created volume successfully. Sep 23 15:19:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-60f9b4cd-254f-42fc-90ef-6efd0b1926d5 tempest-ProjectReaderTests-768611755 None] Acquiring lock "cinder-e757404a-47a2-43af-a40f-0945985f07a4-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-60f9b4cd-254f-42fc-90ef-6efd0b1926d5 tempest-ProjectReaderTests-768611755 None] Lock "cinder-e757404a-47a2-43af-a40f-0945985f07a4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-60f9b4cd-254f-42fc-90ef-6efd0b1926d5 tempest-ProjectReaderTests-768611755 None] Acquiring lock "cinder-quobyte-e757404a-47a2-43af-a40f-0945985f07a4" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-60f9b4cd-254f-42fc-90ef-6efd0b1926d5 tempest-ProjectReaderTests-768611755 None] Lock "cinder-quobyte-e757404a-47a2-43af-a40f-0945985f07a4" acquired by "delete_volume" :: waited 0.021s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:35 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb29307-5987-451d-92c4-a7fc3e07011f]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:19:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60f9b4cd-254f-42fc-90ef-6efd0b1926d5 tempest-ProjectReaderTests-768611755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e757404a-47a2-43af-a40f-0945985f07a4 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:35 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e757404a-47a2-43af-a40f-0945985f07a4 Sep 23 15:19:35 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:36 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:19:36 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:36 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60f9b4cd-254f-42fc-90ef-6efd0b1926d5 tempest-ProjectReaderTests-768611755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e757404a-47a2-43af-a40f-0945985f07a4" returned: 0 in 0.655s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60f9b4cd-254f-42fc-90ef-6efd0b1926d5 tempest-ProjectReaderTests-768611755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e757404a-47a2-43af-a40f-0945985f07a4 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:36 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e757404a-47a2-43af-a40f-0945985f07a4 Sep 23 15:19:36 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:36 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.491s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 28 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:19:36 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60f9b4cd-254f-42fc-90ef-6efd0b1926d5 tempest-ProjectReaderTests-768611755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e757404a-47a2-43af-a40f-0945985f07a4" returned: 0 in 0.293s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-60f9b4cd-254f-42fc-90ef-6efd0b1926d5 tempest-ProjectReaderTests-768611755 None] Lock "cinder-quobyte-e757404a-47a2-43af-a40f-0945985f07a4" released by "delete_volume" :: held 1.012s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-60f9b4cd-254f-42fc-90ef-6efd0b1926d5 tempest-ProjectReaderTests-768611755 None] Created reservations ['29bacca0-91d5-46bb-a206-2cbbb93ac1eb', 'ee5985bb-8cda-4222-8e06-d39295a1ad27', 'd23ceea1-f4bd-4dcc-b635-1efa6abd9d8c', 'a0fdc10c-f15b-45ae-9eee-3d7bb8a3bbfd'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-60f9b4cd-254f-42fc-90ef-6efd0b1926d5 tempest-ProjectReaderTests-768611755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-60f9b4cd-254f-42fc-90ef-6efd0b1926d5 tempest-ProjectReaderTests-768611755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-60f9b4cd-254f-42fc-90ef-6efd0b1926d5 tempest-ProjectReaderTests-768611755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-60f9b4cd-254f-42fc-90ef-6efd0b1926d5 tempest-ProjectReaderTests-768611755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-60f9b4cd-254f-42fc-90ef-6efd0b1926d5 tempest-ProjectReaderTests-768611755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60f9b4cd-254f-42fc-90ef-6efd0b1926d5 tempest-ProjectReaderTests-768611755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:36 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:19:36 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:37 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60f9b4cd-254f-42fc-90ef-6efd0b1926d5 tempest-ProjectReaderTests-768611755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.277s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:37 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-60f9b4cd-254f-42fc-90ef-6efd0b1926d5 tempest-ProjectReaderTests-768611755 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:19:37 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-60f9b4cd-254f-42fc-90ef-6efd0b1926d5 tempest-ProjectReaderTests-768611755 None] Deleted volume successfully. Sep 23 15:19:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-60f9b4cd-254f-42fc-90ef-6efd0b1926d5 tempest-ProjectReaderTests-768611755 None] Lock "cinder-e757404a-47a2-43af-a40f-0945985f07a4-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:38 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:19:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Flow 'volume_create_manager' (365d50a0-f227-4104-977f-7fb4dba6b6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:19:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7185bfec-1ea6-4b4f-a3c6-7fcbf58e1841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7185bfec-1ea6-4b4f-a3c6-7fcbf58e1841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1629367066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99109dd8-49fe-45db-831e-7910cc415922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a899cdfbf59d4fc3ae670440b4d8e367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:19:38Z,use_quota=True,user_id='42f79a8c76d9416382f3de6f010deb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fee4a31-f899-44b8-84c6-5078d1f6a444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fee4a31-f899-44b8-84c6-5078d1f6a444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e2b7413-af57-4c5b-88b1-339e8ba7b151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e2b7413-af57-4c5b-88b1-339e8ba7b151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99109dd8-49fe-45db-831e-7910cc415922', 'volume_name': 'volume-99109dd8-49fe-45db-831e-7910cc415922', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57b04bb-bf69-4a47-8bd4-c58783c6d597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57b04bb-bf69-4a47-8bd4-c58783c6d597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9679a9f7-1680-48fb-afd7-1f55f4d65b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:38 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Volume 99109dd8-49fe-45db-831e-7910cc415922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99109dd8-49fe-45db-831e-7910cc415922', 'volume_size': 1} Sep 23 15:19:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1629367066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99109dd8-49fe-45db-831e-7910cc415922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a899cdfbf59d4fc3ae670440b4d8e367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:19:38Z,use_quota=True,user_id='42f79a8c76d9416382f3de6f010deb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:19:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Creating volume 99109dd8-49fe-45db-831e-7910cc415922 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:19:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:19:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:19:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:19:38 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:19:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99109dd8-49fe-45db-831e-7910cc415922 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:38 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99109dd8-49fe-45db-831e-7910cc415922 1073741824 Sep 23 15:19:38 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:39 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99109dd8-49fe-45db-831e-7910cc415922 1073741824" returned: 0 in 0.752s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99109dd8-49fe-45db-831e-7910cc415922 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:39 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99109dd8-49fe-45db-831e-7910cc415922 Sep 23 15:19:39 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:39 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99109dd8-49fe-45db-831e-7910cc415922" returned: 0 in 0.368s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:19:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9679a9f7-1680-48fb-afd7-1f55f4d65b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99109dd8-49fe-45db-831e-7910cc415922', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71973c3d-d88f-4230-bce3-708a63ffa5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:19:39 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Volume volume-99109dd8-49fe-45db-831e-7910cc415922 (99109dd8-49fe-45db-831e-7910cc415922): created successfully Sep 23 15:19:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71973c3d-d88f-4230-bce3-708a63ffa5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:19:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Flow 'volume_create_manager' (365d50a0-f227-4104-977f-7fb4dba6b6c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:19:39 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-6afcb1f3-5496-45a2-8702-652f1eb0375c tempest-ProjectReaderTests-768611755 None] Created volume successfully. Sep 23 15:19:40 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aae0d7a2-776a-4794-a214-9c14ea21c4ef tempest-ProjectReaderTests-768611755 None] Acquiring lock "cinder-99109dd8-49fe-45db-831e-7910cc415922-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:40 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aae0d7a2-776a-4794-a214-9c14ea21c4ef tempest-ProjectReaderTests-768611755 None] Lock "cinder-99109dd8-49fe-45db-831e-7910cc415922-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:40 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aae0d7a2-776a-4794-a214-9c14ea21c4ef tempest-ProjectReaderTests-768611755 None] Acquiring lock "cinder-quobyte-99109dd8-49fe-45db-831e-7910cc415922" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:19:40 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aae0d7a2-776a-4794-a214-9c14ea21c4ef tempest-ProjectReaderTests-768611755 None] Lock "cinder-quobyte-99109dd8-49fe-45db-831e-7910cc415922" acquired by "delete_volume" :: waited 0.019s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:19:40 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[96134d13-fa55-47dd-9353-349e35500fe7]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:19:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aae0d7a2-776a-4794-a214-9c14ea21c4ef tempest-ProjectReaderTests-768611755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99109dd8-49fe-45db-831e-7910cc415922 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:40 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99109dd8-49fe-45db-831e-7910cc415922 Sep 23 15:19:40 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:41 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aae0d7a2-776a-4794-a214-9c14ea21c4ef tempest-ProjectReaderTests-768611755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99109dd8-49fe-45db-831e-7910cc415922" returned: 0 in 0.501s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aae0d7a2-776a-4794-a214-9c14ea21c4ef tempest-ProjectReaderTests-768611755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99109dd8-49fe-45db-831e-7910cc415922 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:41 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99109dd8-49fe-45db-831e-7910cc415922 Sep 23 15:19:41 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:41 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aae0d7a2-776a-4794-a214-9c14ea21c4ef tempest-ProjectReaderTests-768611755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99109dd8-49fe-45db-831e-7910cc415922" returned: 0 in 0.284s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aae0d7a2-776a-4794-a214-9c14ea21c4ef tempest-ProjectReaderTests-768611755 None] Lock "cinder-quobyte-99109dd8-49fe-45db-831e-7910cc415922" released by "delete_volume" :: held 0.849s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:41 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-aae0d7a2-776a-4794-a214-9c14ea21c4ef tempest-ProjectReaderTests-768611755 None] Created reservations ['7765f55c-30d2-4f9b-879e-82556846d81d', '4a7856e3-a7fd-4e4e-bae0-f8a2339fd322', '6abf552a-7596-46d4-9c10-0f1a089c3671', '6162e8bc-1c53-4031-a03f-d09e01299ffb'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:19:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-aae0d7a2-776a-4794-a214-9c14ea21c4ef tempest-ProjectReaderTests-768611755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:19:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-aae0d7a2-776a-4794-a214-9c14ea21c4ef tempest-ProjectReaderTests-768611755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:19:41 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-aae0d7a2-776a-4794-a214-9c14ea21c4ef tempest-ProjectReaderTests-768611755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:19:41 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-aae0d7a2-776a-4794-a214-9c14ea21c4ef tempest-ProjectReaderTests-768611755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:19:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-aae0d7a2-776a-4794-a214-9c14ea21c4ef tempest-ProjectReaderTests-768611755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:19:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aae0d7a2-776a-4794-a214-9c14ea21c4ef tempest-ProjectReaderTests-768611755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:19:41 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:19:41 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:19:42 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Sep 23 15:19:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aae0d7a2-776a-4794-a214-9c14ea21c4ef tempest-ProjectReaderTests-768611755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.387s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:19:42 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-aae0d7a2-776a-4794-a214-9c14ea21c4ef tempest-ProjectReaderTests-768611755 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:19:42 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-aae0d7a2-776a-4794-a214-9c14ea21c4ef tempest-ProjectReaderTests-768611755 None] Deleted volume successfully. Sep 23 15:19:42 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aae0d7a2-776a-4794-a214-9c14ea21c4ef tempest-ProjectReaderTests-768611755 None] Lock "cinder-99109dd8-49fe-45db-831e-7910cc415922-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:19:51 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=99,cinder:INSERT=36,cinder:UPDATE=142,cinder:DELETE=15 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:19:52 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:UPDATE=132,cinder:SELECT=106,cinder:INSERT=35,cinder:DELETE=7 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:19:59 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:19:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Flow 'volume_create_manager' (6ce8da6d-b66f-4d03-9263-89826a7e5f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:19:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbde7af2-9ca2-4f68-9110-deba51b5c8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbde7af2-9ca2-4f68-9110-deba51b5c8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-189723286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868cfcc6-d21e-4e86-98a8-c034561263e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147bad69f20a418296f3a631e76df1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:20:00Z,use_quota=True,user_id='388e0feea9ea4aa2b8c688d6599098b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db033768-8b7f-425f-9312-68729f6ab5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db033768-8b7f-425f-9312-68729f6ab5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5c4c87-6bf0-4594-813e-019e84a04984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5c4c87-6bf0-4594-813e-019e84a04984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '868cfcc6-d21e-4e86-98a8-c034561263e4', 'volume_name': 'volume-868cfcc6-d21e-4e86-98a8-c034561263e4', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a110d9-69ab-4426-8d4e-537dc44498ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a110d9-69ab-4426-8d4e-537dc44498ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a38f37-b055-4ca2-8fa6-8892267cbf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:00 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Volume 868cfcc6-d21e-4e86-98a8-c034561263e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-868cfcc6-d21e-4e86-98a8-c034561263e4', 'volume_size': 1} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-189723286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868cfcc6-d21e-4e86-98a8-c034561263e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147bad69f20a418296f3a631e76df1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:20:00Z,use_quota=True,user_id='388e0feea9ea4aa2b8c688d6599098b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Creating volume 868cfcc6-d21e-4e86-98a8-c034561263e4 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:20:00 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-868cfcc6-d21e-4e86-98a8-c034561263e4 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:00 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-868cfcc6-d21e-4e86-98a8-c034561263e4 1073741824 Sep 23 15:20:00 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:00 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-868cfcc6-d21e-4e86-98a8-c034561263e4 1073741824" returned: 0 in 0.545s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-868cfcc6-d21e-4e86-98a8-c034561263e4 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:00 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-868cfcc6-d21e-4e86-98a8-c034561263e4 Sep 23 15:20:00 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:00 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-868cfcc6-d21e-4e86-98a8-c034561263e4" returned: 0 in 0.284s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a38f37-b055-4ca2-8fa6-8892267cbf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-868cfcc6-d21e-4e86-98a8-c034561263e4', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d06621b-b237-44d1-a0b3-10cb24c194f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:00 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Volume volume-868cfcc6-d21e-4e86-98a8-c034561263e4 (868cfcc6-d21e-4e86-98a8-c034561263e4): created successfully Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d06621b-b237-44d1-a0b3-10cb24c194f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Flow 'volume_create_manager' (6ce8da6d-b66f-4d03-9263-89826a7e5f4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:20:01 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-ad190ebc-3c93-489c-a76d-42af17516a56 tempest-ProjectReaderTests-1782748348 None] Created volume successfully. Sep 23 15:20:02 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-98df4556-caa2-4e22-abe6-50b22a6c4d68 tempest-ProjectReaderTests-1782748348 None] Acquiring lock "cinder-868cfcc6-d21e-4e86-98a8-c034561263e4-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:20:02 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-98df4556-caa2-4e22-abe6-50b22a6c4d68 tempest-ProjectReaderTests-1782748348 None] Lock "cinder-868cfcc6-d21e-4e86-98a8-c034561263e4-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:20:02 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-98df4556-caa2-4e22-abe6-50b22a6c4d68 tempest-ProjectReaderTests-1782748348 None] Acquiring lock "cinder-quobyte-868cfcc6-d21e-4e86-98a8-c034561263e4" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:20:02 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-98df4556-caa2-4e22-abe6-50b22a6c4d68 tempest-ProjectReaderTests-1782748348 None] Lock "cinder-quobyte-868cfcc6-d21e-4e86-98a8-c034561263e4" acquired by "delete_volume" :: waited 0.013s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:20:02 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a00a3ca-a3d7-4eeb-affc-958211c35860]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:20:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98df4556-caa2-4e22-abe6-50b22a6c4d68 tempest-ProjectReaderTests-1782748348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-868cfcc6-d21e-4e86-98a8-c034561263e4 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:02 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-868cfcc6-d21e-4e86-98a8-c034561263e4 Sep 23 15:20:02 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:02 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98df4556-caa2-4e22-abe6-50b22a6c4d68 tempest-ProjectReaderTests-1782748348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-868cfcc6-d21e-4e86-98a8-c034561263e4" returned: 0 in 0.515s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98df4556-caa2-4e22-abe6-50b22a6c4d68 tempest-ProjectReaderTests-1782748348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-868cfcc6-d21e-4e86-98a8-c034561263e4 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:02 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-868cfcc6-d21e-4e86-98a8-c034561263e4 Sep 23 15:20:02 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:03 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98df4556-caa2-4e22-abe6-50b22a6c4d68 tempest-ProjectReaderTests-1782748348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-868cfcc6-d21e-4e86-98a8-c034561263e4" returned: 0 in 0.300s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:03 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-98df4556-caa2-4e22-abe6-50b22a6c4d68 tempest-ProjectReaderTests-1782748348 None] Lock "cinder-quobyte-868cfcc6-d21e-4e86-98a8-c034561263e4" released by "delete_volume" :: held 0.867s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:20:03 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-98df4556-caa2-4e22-abe6-50b22a6c4d68 tempest-ProjectReaderTests-1782748348 None] Created reservations ['70b7bd15-c9ad-4c26-a730-a2528253ad6e', '245ad1e2-6b15-47e9-9524-ae6749d6e7c2', '939f3848-98f7-426b-b13d-4c8aa102ecdd', 'c8015b70-c297-4513-9c34-9480ac8548bc'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:20:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-98df4556-caa2-4e22-abe6-50b22a6c4d68 tempest-ProjectReaderTests-1782748348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:20:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-98df4556-caa2-4e22-abe6-50b22a6c4d68 tempest-ProjectReaderTests-1782748348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:20:03 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-98df4556-caa2-4e22-abe6-50b22a6c4d68 tempest-ProjectReaderTests-1782748348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:20:03 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-98df4556-caa2-4e22-abe6-50b22a6c4d68 tempest-ProjectReaderTests-1782748348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:20:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-98df4556-caa2-4e22-abe6-50b22a6c4d68 tempest-ProjectReaderTests-1782748348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:20:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98df4556-caa2-4e22-abe6-50b22a6c4d68 tempest-ProjectReaderTests-1782748348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:03 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:20:03 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:03 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98df4556-caa2-4e22-abe6-50b22a6c4d68 tempest-ProjectReaderTests-1782748348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.356s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:03 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-98df4556-caa2-4e22-abe6-50b22a6c4d68 tempest-ProjectReaderTests-1782748348 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:20:03 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-98df4556-caa2-4e22-abe6-50b22a6c4d68 tempest-ProjectReaderTests-1782748348 None] Deleted volume successfully. Sep 23 15:20:03 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-98df4556-caa2-4e22-abe6-50b22a6c4d68 tempest-ProjectReaderTests-1782748348 None] Lock "cinder-868cfcc6-d21e-4e86-98a8-c034561263e4-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Flow 'volume_create_manager' (eb6e144b-0ff4-4407-bf8f-138567cc9f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981c970e-9ca7-413a-b6ec-bfd4a36094e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981c970e-9ca7-413a-b6ec-bfd4a36094e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1258247735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dcaa05d-97f0-4c20-80f8-86007e60ce62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147bad69f20a418296f3a631e76df1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:20:04Z,use_quota=True,user_id='388e0feea9ea4aa2b8c688d6599098b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad223c2f-f3c9-4412-aabf-99a4eb37ec80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad223c2f-f3c9-4412-aabf-99a4eb37ec80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476ef212-3d49-4718-b99c-3e020e05bffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476ef212-3d49-4718-b99c-3e020e05bffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dcaa05d-97f0-4c20-80f8-86007e60ce62', 'volume_name': 'volume-8dcaa05d-97f0-4c20-80f8-86007e60ce62', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e78f87-5c46-49a8-82d6-7e0be3e3405c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e78f87-5c46-49a8-82d6-7e0be3e3405c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83af579-a3d0-4b2d-9fe0-4365a44edfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:04 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Volume 8dcaa05d-97f0-4c20-80f8-86007e60ce62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dcaa05d-97f0-4c20-80f8-86007e60ce62', 'volume_size': 1} Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1258247735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dcaa05d-97f0-4c20-80f8-86007e60ce62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147bad69f20a418296f3a631e76df1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:20:04Z,use_quota=True,user_id='388e0feea9ea4aa2b8c688d6599098b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Creating volume 8dcaa05d-97f0-4c20-80f8-86007e60ce62 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:20:04 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8dcaa05d-97f0-4c20-80f8-86007e60ce62 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:04 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8dcaa05d-97f0-4c20-80f8-86007e60ce62 1073741824 Sep 23 15:20:04 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:04 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8dcaa05d-97f0-4c20-80f8-86007e60ce62 1073741824" returned: 0 in 0.568s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8dcaa05d-97f0-4c20-80f8-86007e60ce62 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:04 devstack sudo[100881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8dcaa05d-97f0-4c20-80f8-86007e60ce62 Sep 23 15:20:04 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:05 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8dcaa05d-97f0-4c20-80f8-86007e60ce62" returned: 0 in 0.342s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:20:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:20:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83af579-a3d0-4b2d-9fe0-4365a44edfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dcaa05d-97f0-4c20-80f8-86007e60ce62', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a1b05b-55b6-411d-91be-0776e96ab840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:05 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Volume volume-8dcaa05d-97f0-4c20-80f8-86007e60ce62 (8dcaa05d-97f0-4c20-80f8-86007e60ce62): created successfully Sep 23 15:20:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a1b05b-55b6-411d-91be-0776e96ab840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Flow 'volume_create_manager' (eb6e144b-0ff4-4407-bf8f-138567cc9f8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:20:05 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-b15af929-fd3c-4bad-9285-25a32e69fcf2 tempest-ProjectReaderTests-1782748348 None] Created volume successfully. Sep 23 15:20:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ee1821dc-4f52-4ef5-a13c-6b2735f7f7b8 tempest-ProjectReaderTests-1782748348 None] Acquiring lock "cinder-8dcaa05d-97f0-4c20-80f8-86007e60ce62-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:20:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ee1821dc-4f52-4ef5-a13c-6b2735f7f7b8 tempest-ProjectReaderTests-1782748348 None] Lock "cinder-8dcaa05d-97f0-4c20-80f8-86007e60ce62-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:20:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ee1821dc-4f52-4ef5-a13c-6b2735f7f7b8 tempest-ProjectReaderTests-1782748348 None] Acquiring lock "cinder-quobyte-8dcaa05d-97f0-4c20-80f8-86007e60ce62" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:20:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ee1821dc-4f52-4ef5-a13c-6b2735f7f7b8 tempest-ProjectReaderTests-1782748348 None] Lock "cinder-quobyte-8dcaa05d-97f0-4c20-80f8-86007e60ce62" acquired by "delete_volume" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:20:06 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[af133be6-b7c3-4c16-9706-b9602edcf7bf]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:20:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ee1821dc-4f52-4ef5-a13c-6b2735f7f7b8 tempest-ProjectReaderTests-1782748348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8dcaa05d-97f0-4c20-80f8-86007e60ce62 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:06 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8dcaa05d-97f0-4c20-80f8-86007e60ce62 Sep 23 15:20:06 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:06 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ee1821dc-4f52-4ef5-a13c-6b2735f7f7b8 tempest-ProjectReaderTests-1782748348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8dcaa05d-97f0-4c20-80f8-86007e60ce62" returned: 0 in 0.472s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ee1821dc-4f52-4ef5-a13c-6b2735f7f7b8 tempest-ProjectReaderTests-1782748348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8dcaa05d-97f0-4c20-80f8-86007e60ce62 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:06 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8dcaa05d-97f0-4c20-80f8-86007e60ce62 Sep 23 15:20:06 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:07 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ee1821dc-4f52-4ef5-a13c-6b2735f7f7b8 tempest-ProjectReaderTests-1782748348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8dcaa05d-97f0-4c20-80f8-86007e60ce62" returned: 0 in 0.304s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:07 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ee1821dc-4f52-4ef5-a13c-6b2735f7f7b8 tempest-ProjectReaderTests-1782748348 None] Lock "cinder-quobyte-8dcaa05d-97f0-4c20-80f8-86007e60ce62" released by "delete_volume" :: held 0.860s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:20:07 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-ee1821dc-4f52-4ef5-a13c-6b2735f7f7b8 tempest-ProjectReaderTests-1782748348 None] Created reservations ['ef00aec6-b63b-4eac-8c5b-4918ef7ae294', '6a375098-63b0-4502-8baa-4456fbd7365f', '85bdaf2f-74b3-4fb2-b31b-1caae759d694', '35923498-f1fb-45a4-858c-2ffa10c757e6'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:20:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ee1821dc-4f52-4ef5-a13c-6b2735f7f7b8 tempest-ProjectReaderTests-1782748348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:20:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ee1821dc-4f52-4ef5-a13c-6b2735f7f7b8 tempest-ProjectReaderTests-1782748348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:20:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ee1821dc-4f52-4ef5-a13c-6b2735f7f7b8 tempest-ProjectReaderTests-1782748348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:20:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ee1821dc-4f52-4ef5-a13c-6b2735f7f7b8 tempest-ProjectReaderTests-1782748348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:20:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ee1821dc-4f52-4ef5-a13c-6b2735f7f7b8 tempest-ProjectReaderTests-1782748348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:20:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ee1821dc-4f52-4ef5-a13c-6b2735f7f7b8 tempest-ProjectReaderTests-1782748348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:07 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:20:07 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:07 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ee1821dc-4f52-4ef5-a13c-6b2735f7f7b8 tempest-ProjectReaderTests-1782748348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.459s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:07 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-ee1821dc-4f52-4ef5-a13c-6b2735f7f7b8 tempest-ProjectReaderTests-1782748348 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:20:07 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-ee1821dc-4f52-4ef5-a13c-6b2735f7f7b8 tempest-ProjectReaderTests-1782748348 None] Deleted volume successfully. Sep 23 15:20:07 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ee1821dc-4f52-4ef5-a13c-6b2735f7f7b8 tempest-ProjectReaderTests-1782748348 None] Lock "cinder-8dcaa05d-97f0-4c20-80f8-86007e60ce62-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:20:08 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:20:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Flow 'volume_create_manager' (e06f91cc-90da-4cfc-8646-f93bd722bbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:20:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc5c119-c02b-4792-8aad-6a48ae695f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc5c119-c02b-4792-8aad-6a48ae695f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2146905218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a9a449-769a-43a3-8e0c-bd79e265e108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147bad69f20a418296f3a631e76df1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:20:08Z,use_quota=True,user_id='388e0feea9ea4aa2b8c688d6599098b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fa2501-d904-48d4-9940-2e126e3ac29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fa2501-d904-48d4-9940-2e126e3ac29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db22a0cd-c93f-48a0-b7e7-a97aa6de7cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db22a0cd-c93f-48a0-b7e7-a97aa6de7cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24a9a449-769a-43a3-8e0c-bd79e265e108', 'volume_name': 'volume-24a9a449-769a-43a3-8e0c-bd79e265e108', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1e8bcf-34ab-439f-aaa2-4e8ecd3ef46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1e8bcf-34ab-439f-aaa2-4e8ecd3ef46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59599f61-956e-4e6e-a876-bc040b18d537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:08 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Volume 24a9a449-769a-43a3-8e0c-bd79e265e108: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24a9a449-769a-43a3-8e0c-bd79e265e108', 'volume_size': 1} Sep 23 15:20:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:20:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:20:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2146905218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a9a449-769a-43a3-8e0c-bd79e265e108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147bad69f20a418296f3a631e76df1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:20:08Z,use_quota=True,user_id='388e0feea9ea4aa2b8c688d6599098b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:20:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Creating volume 24a9a449-769a-43a3-8e0c-bd79e265e108 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:20:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:20:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:20:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:20:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:20:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:20:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:20:08 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:20:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-24a9a449-769a-43a3-8e0c-bd79e265e108 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:08 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-24a9a449-769a-43a3-8e0c-bd79e265e108 1073741824 Sep 23 15:20:08 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:09 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-24a9a449-769a-43a3-8e0c-bd79e265e108 1073741824" returned: 0 in 0.652s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-24a9a449-769a-43a3-8e0c-bd79e265e108 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:09 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-24a9a449-769a-43a3-8e0c-bd79e265e108 Sep 23 15:20:09 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:09 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-24a9a449-769a-43a3-8e0c-bd79e265e108" returned: 0 in 0.361s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:09 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:20:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:20:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59599f61-956e-4e6e-a876-bc040b18d537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24a9a449-769a-43a3-8e0c-bd79e265e108', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f2cd1b4-0e77-4e30-b3e7-a79d2b584508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:09 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Volume volume-24a9a449-769a-43a3-8e0c-bd79e265e108 (24a9a449-769a-43a3-8e0c-bd79e265e108): created successfully Sep 23 15:20:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f2cd1b4-0e77-4e30-b3e7-a79d2b584508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Flow 'volume_create_manager' (e06f91cc-90da-4cfc-8646-f93bd722bbfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:20:09 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-1cd2f8c3-9bd8-4f95-ac43-2c7b64ae1785 tempest-ProjectReaderTests-1782748348 None] Created volume successfully. Sep 23 15:20:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-98cf6fed-0e3f-4db2-b380-aa4a443407b0 tempest-ProjectReaderTests-1782748348 None] Acquiring lock "cinder-24a9a449-769a-43a3-8e0c-bd79e265e108-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:20:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-98cf6fed-0e3f-4db2-b380-aa4a443407b0 tempest-ProjectReaderTests-1782748348 None] Lock "cinder-24a9a449-769a-43a3-8e0c-bd79e265e108-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:20:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-98cf6fed-0e3f-4db2-b380-aa4a443407b0 tempest-ProjectReaderTests-1782748348 None] Acquiring lock "cinder-quobyte-24a9a449-769a-43a3-8e0c-bd79e265e108" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:20:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-98cf6fed-0e3f-4db2-b380-aa4a443407b0 tempest-ProjectReaderTests-1782748348 None] Lock "cinder-quobyte-24a9a449-769a-43a3-8e0c-bd79e265e108" acquired by "delete_volume" :: waited 0.021s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:20:10 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[96312e45-16e8-4cf2-b5cd-2bce1ece81f7]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:20:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98cf6fed-0e3f-4db2-b380-aa4a443407b0 tempest-ProjectReaderTests-1782748348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-24a9a449-769a-43a3-8e0c-bd79e265e108 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:10 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-24a9a449-769a-43a3-8e0c-bd79e265e108 Sep 23 15:20:10 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:11 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98cf6fed-0e3f-4db2-b380-aa4a443407b0 tempest-ProjectReaderTests-1782748348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-24a9a449-769a-43a3-8e0c-bd79e265e108" returned: 0 in 0.603s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98cf6fed-0e3f-4db2-b380-aa4a443407b0 tempest-ProjectReaderTests-1782748348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-24a9a449-769a-43a3-8e0c-bd79e265e108 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:11 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-24a9a449-769a-43a3-8e0c-bd79e265e108 Sep 23 15:20:11 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:11 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98cf6fed-0e3f-4db2-b380-aa4a443407b0 tempest-ProjectReaderTests-1782748348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-24a9a449-769a-43a3-8e0c-bd79e265e108" returned: 0 in 0.391s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:11 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-98cf6fed-0e3f-4db2-b380-aa4a443407b0 tempest-ProjectReaderTests-1782748348 None] Lock "cinder-quobyte-24a9a449-769a-43a3-8e0c-bd79e265e108" released by "delete_volume" :: held 1.077s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:20:11 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-98cf6fed-0e3f-4db2-b380-aa4a443407b0 tempest-ProjectReaderTests-1782748348 None] Created reservations ['d9089dba-849c-493f-8c90-828a5602becb', '82304b9b-1ade-4fef-90a0-9b14f25fa7cd', '4d0a7bef-5c56-4aca-b69f-b91ac68d12ec', '7c48ff13-02ac-4ac7-a482-18c985c1920f'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:20:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-98cf6fed-0e3f-4db2-b380-aa4a443407b0 tempest-ProjectReaderTests-1782748348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:20:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-98cf6fed-0e3f-4db2-b380-aa4a443407b0 tempest-ProjectReaderTests-1782748348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:20:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-98cf6fed-0e3f-4db2-b380-aa4a443407b0 tempest-ProjectReaderTests-1782748348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:20:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-98cf6fed-0e3f-4db2-b380-aa4a443407b0 tempest-ProjectReaderTests-1782748348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:20:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-98cf6fed-0e3f-4db2-b380-aa4a443407b0 tempest-ProjectReaderTests-1782748348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:20:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98cf6fed-0e3f-4db2-b380-aa4a443407b0 tempest-ProjectReaderTests-1782748348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:12 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:20:12 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:12 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98cf6fed-0e3f-4db2-b380-aa4a443407b0 tempest-ProjectReaderTests-1782748348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.347s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:12 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-98cf6fed-0e3f-4db2-b380-aa4a443407b0 tempest-ProjectReaderTests-1782748348 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:20:12 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-98cf6fed-0e3f-4db2-b380-aa4a443407b0 tempest-ProjectReaderTests-1782748348 None] Deleted volume successfully. Sep 23 15:20:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-98cf6fed-0e3f-4db2-b380-aa4a443407b0 tempest-ProjectReaderTests-1782748348 None] Lock "cinder-24a9a449-769a-43a3-8e0c-bd79e265e108-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:20:13 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:20:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Flow 'volume_create_manager' (b37f853c-f2bf-4995-9627-60a8ff8fad99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:20:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c334abf-62ed-47b8-b951-a404fd50e916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c334abf-62ed-47b8-b951-a404fd50e916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1786245493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fce611e-a431-453c-8298-6145518b1432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147bad69f20a418296f3a631e76df1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:20:14Z,use_quota=True,user_id='388e0feea9ea4aa2b8c688d6599098b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed34cd9-fd75-47d6-88fc-5a4b6d1e9874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed34cd9-fd75-47d6-88fc-5a4b6d1e9874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c776a4-6c9f-46bb-91c9-419bf64e7ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c776a4-6c9f-46bb-91c9-419bf64e7ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fce611e-a431-453c-8298-6145518b1432', 'volume_name': 'volume-3fce611e-a431-453c-8298-6145518b1432', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0217981-0f77-40a4-8442-b126d4160f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0217981-0f77-40a4-8442-b126d4160f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92eed893-b6e4-4f07-a3dc-0c75c7692585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:13 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Volume 3fce611e-a431-453c-8298-6145518b1432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fce611e-a431-453c-8298-6145518b1432', 'volume_size': 1} Sep 23 15:20:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:20:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:20:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1786245493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fce611e-a431-453c-8298-6145518b1432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147bad69f20a418296f3a631e76df1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:20:14Z,use_quota=True,user_id='388e0feea9ea4aa2b8c688d6599098b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:20:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Creating volume 3fce611e-a431-453c-8298-6145518b1432 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:20:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:20:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:20:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:20:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:20:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:20:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:20:13 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:20:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3fce611e-a431-453c-8298-6145518b1432 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:13 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3fce611e-a431-453c-8298-6145518b1432 1073741824 Sep 23 15:20:13 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:14 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3fce611e-a431-453c-8298-6145518b1432 1073741824" returned: 0 in 0.556s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3fce611e-a431-453c-8298-6145518b1432 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:14 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3fce611e-a431-453c-8298-6145518b1432 Sep 23 15:20:14 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:14 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3fce611e-a431-453c-8298-6145518b1432" returned: 0 in 0.302s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:20:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:20:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92eed893-b6e4-4f07-a3dc-0c75c7692585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fce611e-a431-453c-8298-6145518b1432', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74cb583d-c2aa-46a3-9542-8b418a00195b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:14 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Volume volume-3fce611e-a431-453c-8298-6145518b1432 (3fce611e-a431-453c-8298-6145518b1432): created successfully Sep 23 15:20:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74cb583d-c2aa-46a3-9542-8b418a00195b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Flow 'volume_create_manager' (b37f853c-f2bf-4995-9627-60a8ff8fad99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:20:14 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-702b7086-5f49-4d44-824c-c8c1df62adab tempest-ProjectReaderTests-1782748348 None] Created volume successfully. Sep 23 15:20:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3a62e02e-3cfb-45a6-8434-60c50c88c46c tempest-ProjectReaderTests-1782748348 None] Acquiring lock "cinder-3fce611e-a431-453c-8298-6145518b1432-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:20:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3a62e02e-3cfb-45a6-8434-60c50c88c46c tempest-ProjectReaderTests-1782748348 None] Lock "cinder-3fce611e-a431-453c-8298-6145518b1432-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:20:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3a62e02e-3cfb-45a6-8434-60c50c88c46c tempest-ProjectReaderTests-1782748348 None] Acquiring lock "cinder-quobyte-3fce611e-a431-453c-8298-6145518b1432" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:20:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3a62e02e-3cfb-45a6-8434-60c50c88c46c tempest-ProjectReaderTests-1782748348 None] Lock "cinder-quobyte-3fce611e-a431-453c-8298-6145518b1432" acquired by "delete_volume" :: waited 0.022s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:20:15 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b0203b-b45a-4226-b34a-b2482ff8553e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:20:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3a62e02e-3cfb-45a6-8434-60c50c88c46c tempest-ProjectReaderTests-1782748348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3fce611e-a431-453c-8298-6145518b1432 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:16 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3fce611e-a431-453c-8298-6145518b1432 Sep 23 15:20:16 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:16 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3a62e02e-3cfb-45a6-8434-60c50c88c46c tempest-ProjectReaderTests-1782748348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3fce611e-a431-453c-8298-6145518b1432" returned: 0 in 0.491s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3a62e02e-3cfb-45a6-8434-60c50c88c46c tempest-ProjectReaderTests-1782748348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3fce611e-a431-453c-8298-6145518b1432 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:16 devstack sudo[100935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3fce611e-a431-453c-8298-6145518b1432 Sep 23 15:20:16 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:16 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3a62e02e-3cfb-45a6-8434-60c50c88c46c tempest-ProjectReaderTests-1782748348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3fce611e-a431-453c-8298-6145518b1432" returned: 0 in 0.318s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3a62e02e-3cfb-45a6-8434-60c50c88c46c tempest-ProjectReaderTests-1782748348 None] Lock "cinder-quobyte-3fce611e-a431-453c-8298-6145518b1432" released by "delete_volume" :: held 0.895s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:20:16 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-3a62e02e-3cfb-45a6-8434-60c50c88c46c tempest-ProjectReaderTests-1782748348 None] Created reservations ['78e6f590-b99b-450f-a63e-23c75954e114', 'fed0a11c-bfed-4619-9e3e-515288d8578b', '5966591e-ceb0-4976-912e-817f9ff80b31', '2f46f719-f1cf-4792-9252-7c7574e03554'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:20:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3a62e02e-3cfb-45a6-8434-60c50c88c46c tempest-ProjectReaderTests-1782748348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:20:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3a62e02e-3cfb-45a6-8434-60c50c88c46c tempest-ProjectReaderTests-1782748348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:20:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3a62e02e-3cfb-45a6-8434-60c50c88c46c tempest-ProjectReaderTests-1782748348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:20:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3a62e02e-3cfb-45a6-8434-60c50c88c46c tempest-ProjectReaderTests-1782748348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:20:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3a62e02e-3cfb-45a6-8434-60c50c88c46c tempest-ProjectReaderTests-1782748348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:20:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3a62e02e-3cfb-45a6-8434-60c50c88c46c tempest-ProjectReaderTests-1782748348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:17 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:20:17 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:17 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3a62e02e-3cfb-45a6-8434-60c50c88c46c tempest-ProjectReaderTests-1782748348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.332s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:17 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-3a62e02e-3cfb-45a6-8434-60c50c88c46c tempest-ProjectReaderTests-1782748348 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:20:17 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-3a62e02e-3cfb-45a6-8434-60c50c88c46c tempest-ProjectReaderTests-1782748348 None] Deleted volume successfully. Sep 23 15:20:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3a62e02e-3cfb-45a6-8434-60c50c88c46c tempest-ProjectReaderTests-1782748348 None] Lock "cinder-3fce611e-a431-453c-8298-6145518b1432-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:20:20 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:20:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Flow 'volume_create_manager' (ebd35439-9100-40fc-acd2-75ab73477eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:20:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa66476-3ef1-41d8-a508-68cdcd509682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa66476-3ef1-41d8-a508-68cdcd509682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1945210683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e06729-78e6-44dc-87e4-0df86b469e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5977751205544ce9b4d50d3a20616d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:20:20Z,use_quota=True,user_id='45dd7896b03c4ae9b5b213b043943f82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8548099-8530-4e83-88dc-6ba6ccb1915f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8548099-8530-4e83-88dc-6ba6ccb1915f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c858871f-0530-41d1-b1bf-8c17a9f72c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c858871f-0530-41d1-b1bf-8c17a9f72c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4e06729-78e6-44dc-87e4-0df86b469e57', 'volume_name': 'volume-c4e06729-78e6-44dc-87e4-0df86b469e57', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb343980-98d8-4f35-b319-c695ff3d09d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb343980-98d8-4f35-b319-c695ff3d09d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb52018-ef4d-45ce-90b1-27859d8adcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:20 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Volume c4e06729-78e6-44dc-87e4-0df86b469e57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4e06729-78e6-44dc-87e4-0df86b469e57', 'volume_size': 1} Sep 23 15:20:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:20:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:20:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1945210683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e06729-78e6-44dc-87e4-0df86b469e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5977751205544ce9b4d50d3a20616d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:20:20Z,use_quota=True,user_id='45dd7896b03c4ae9b5b213b043943f82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:20:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Creating volume c4e06729-78e6-44dc-87e4-0df86b469e57 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:20:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:20:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:20:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:20:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:20:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:20:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:20:20 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:20:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:20 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 1073741824 Sep 23 15:20:20 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:21 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 1073741824" returned: 0 in 0.851s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:21 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 Sep 23 15:20:21 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:21 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57" returned: 0 in 0.409s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:20:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:20:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb52018-ef4d-45ce-90b1-27859d8adcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4e06729-78e6-44dc-87e4-0df86b469e57', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7130a54d-3e41-4fb8-80e0-1e2e7d20152e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:21 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Volume volume-c4e06729-78e6-44dc-87e4-0df86b469e57 (c4e06729-78e6-44dc-87e4-0df86b469e57): created successfully Sep 23 15:20:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7130a54d-3e41-4fb8-80e0-1e2e7d20152e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Flow 'volume_create_manager' (ebd35439-9100-40fc-acd2-75ab73477eb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:20:21 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-72b11855-a832-4662-b18a-ea1c67183782 tempest-VolumesActionsTest-2064988386 None] Created volume successfully. Sep 23 15:20:24 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:20:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Flow 'volume_create_manager' (818ccf0a-f5ec-4b0c-b35e-51e3e2d68f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:20:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88284658-dbf4-4aaf-977e-0d22da76bb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88284658-dbf4-4aaf-977e-0d22da76bb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-784803524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b68c37-42e3-4232-8775-c79538c4075e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a93140b5114d46b35f9be166b9d694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:20:25Z,use_quota=True,user_id='8c820faec8164db28cf404081a081b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2728f06-51bb-45df-8702-cecec14a082f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2728f06-51bb-45df-8702-cecec14a082f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae02be6-5e5e-4b29-8a68-644a0ccdfe29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae02be6-5e5e-4b29-8a68-644a0ccdfe29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87b68c37-42e3-4232-8775-c79538c4075e', 'volume_name': 'volume-87b68c37-42e3-4232-8775-c79538c4075e', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb8f7c9-8d92-4f03-a104-2104fc838e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb8f7c9-8d92-4f03-a104-2104fc838e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a488ba23-79cd-4e2f-983e-99c3d3bfa908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:24 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Volume 87b68c37-42e3-4232-8775-c79538c4075e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87b68c37-42e3-4232-8775-c79538c4075e', 'volume_size': 1} Sep 23 15:20:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:20:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:20:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-784803524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b68c37-42e3-4232-8775-c79538c4075e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a93140b5114d46b35f9be166b9d694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:20:25Z,use_quota=True,user_id='8c820faec8164db28cf404081a081b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:20:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Creating volume 87b68c37-42e3-4232-8775-c79538c4075e {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:20:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:20:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:20:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:20:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:20:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:20:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:20:24 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:20:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:24 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e 1073741824 Sep 23 15:20:24 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:25 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e 1073741824" returned: 0 in 0.675s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:25 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e Sep 23 15:20:25 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:26 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e" returned: 0 in 0.545s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:20:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:20:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a488ba23-79cd-4e2f-983e-99c3d3bfa908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87b68c37-42e3-4232-8775-c79538c4075e', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f448b18a-3aa2-4b9a-b2b2-c36a8899bc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:26 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Volume volume-87b68c37-42e3-4232-8775-c79538c4075e (87b68c37-42e3-4232-8775-c79538c4075e): created successfully Sep 23 15:20:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f448b18a-3aa2-4b9a-b2b2-c36a8899bc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Flow 'volume_create_manager' (818ccf0a-f5ec-4b0c-b35e-51e3e2d68f3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:20:26 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-026711ae-0ac9-437b-9710-011e700b323b tempest-TestStampPattern-757802660 None] Created volume successfully. Sep 23 15:20:34 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:20:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Flow 'volume_create_manager' (7ce648ab-89ec-44b9-83cb-d00e77e9981a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:20:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de31b484-26ee-4e9c-904e-350a6bf90b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de31b484-26ee-4e9c-904e-350a6bf90b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1424269417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3da280-49c5-4027-8ff7-2281071743de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1763889967d4d43a884331d3964e41f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:20:34Z,use_quota=True,user_id='0f1b6f4946f84b649258978748407a20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (204209af-8f33-42c7-89e9-021dde5d7dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (204209af-8f33-42c7-89e9-021dde5d7dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7cc36e-32f8-46d7-a2d4-a96ffb012188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7cc36e-32f8-46d7-a2d4-a96ffb012188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3da280-49c5-4027-8ff7-2281071743de', 'volume_name': 'volume-6b3da280-49c5-4027-8ff7-2281071743de', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7552b1e7-b3ba-4a22-91d4-cbbb09752ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7552b1e7-b3ba-4a22-91d4-cbbb09752ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc7aaa3-e0a8-4e32-bd05-1f0fdbffce0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:34 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Volume 6b3da280-49c5-4027-8ff7-2281071743de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3da280-49c5-4027-8ff7-2281071743de', 'volume_size': 1} Sep 23 15:20:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:20:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:20:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1424269417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3da280-49c5-4027-8ff7-2281071743de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1763889967d4d43a884331d3964e41f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:20:34Z,use_quota=True,user_id='0f1b6f4946f84b649258978748407a20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:20:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Creating volume 6b3da280-49c5-4027-8ff7-2281071743de {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:20:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:20:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:20:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:20:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:20:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:20:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:20:34 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:20:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6b3da280-49c5-4027-8ff7-2281071743de 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:34 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6b3da280-49c5-4027-8ff7-2281071743de 1073741824 Sep 23 15:20:34 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:20:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:20:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:20:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:20:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:20:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:20:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:36 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:20:36 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:36 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6b3da280-49c5-4027-8ff7-2281071743de 1073741824" returned: 0 in 1.954s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6b3da280-49c5-4027-8ff7-2281071743de {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:36 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6b3da280-49c5-4027-8ff7-2281071743de Sep 23 15:20:36 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:37 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.914s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:37 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:20:37 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:20:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 28 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:20:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:20:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7da3b67e-08c2-4229-b62c-da11775cea10 tempest-VolumesActionsTest-2064988386 None] Acquiring lock "cinder-c4e06729-78e6-44dc-87e4-0df86b469e57" by "attach_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:20:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7da3b67e-08c2-4229-b62c-da11775cea10 tempest-VolumesActionsTest-2064988386 None] Lock "cinder-c4e06729-78e6-44dc-87e4-0df86b469e57" acquired by "attach_volume" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:20:37 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6b3da280-49c5-4027-8ff7-2281071743de" returned: 0 in 0.962s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:37 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] <== create_volume: return (3116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:20:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.120s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:20:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc7aaa3-e0a8-4e32-bd05-1f0fdbffce0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3da280-49c5-4027-8ff7-2281071743de', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb75e3a-4bb5-4555-9a01-dd145b8ed10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:20:37 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7da3b67e-08c2-4229-b62c-da11775cea10 tempest-VolumesActionsTest-2064988386 None] Attaching volume c4e06729-78e6-44dc-87e4-0df86b469e57 to instance f4a2df33-343f-48d0-bf1e-a69d37254643 at mountpoint /dev/vdb on host None. Sep 23 15:20:37 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Volume volume-6b3da280-49c5-4027-8ff7-2281071743de (6b3da280-49c5-4027-8ff7-2281071743de): created successfully Sep 23 15:20:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb75e3a-4bb5-4555-9a01-dd145b8ed10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:20:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Flow 'volume_create_manager' (7ce648ab-89ec-44b9-83cb-d00e77e9981a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:20:37 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-8d7f4b5a-4425-4b54-af4e-428671752e26 tempest-TestMinimumBasicScenario-709040934 None] Created volume successfully. Sep 23 15:20:37 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7da3b67e-08c2-4229-b62c-da11775cea10 tempest-VolumesActionsTest-2064988386 None] Attach volume completed successfully. Sep 23 15:20:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7da3b67e-08c2-4229-b62c-da11775cea10 tempest-VolumesActionsTest-2064988386 None] Lock "cinder-c4e06729-78e6-44dc-87e4-0df86b469e57" released by "attach_volume" :: held 0.222s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:20:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bcdd63fb-c5a1-4a36-8668-62221c93db3a tempest-VolumesActionsTest-2064988386 None] Acquiring lock "cinder-c4e06729-78e6-44dc-87e4-0df86b469e57-detach_volume" by "detach_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:20:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bcdd63fb-c5a1-4a36-8668-62221c93db3a tempest-VolumesActionsTest-2064988386 None] Lock "cinder-c4e06729-78e6-44dc-87e4-0df86b469e57-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:20:37 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-bcdd63fb-c5a1-4a36-8668-62221c93db3a tempest-VolumesActionsTest-2064988386 None] Detaching volume c4e06729-78e6-44dc-87e4-0df86b469e57 from instance f4a2df33-343f-48d0-bf1e-a69d37254643. Sep 23 15:20:38 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-bcdd63fb-c5a1-4a36-8668-62221c93db3a tempest-VolumesActionsTest-2064988386 None] Detach volume completed successfully. Sep 23 15:20:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bcdd63fb-c5a1-4a36-8668-62221c93db3a tempest-VolumesActionsTest-2064988386 None] Lock "cinder-c4e06729-78e6-44dc-87e4-0df86b469e57-detach_volume" released by "detach_volume" :: held 0.102s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:20:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-74a11419-1a26-4ad5-a069-38ad9d061598 req-4eaf1a4e-f46c-42cb-8403-2012e9d5396c tempest-TestMinimumBasicScenario-709040934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:20:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-74a11419-1a26-4ad5-a069-38ad9d061598 req-4eaf1a4e-f46c-42cb-8403-2012e9d5396c tempest-TestMinimumBasicScenario-709040934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:20:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-74a11419-1a26-4ad5-a069-38ad9d061598 req-4eaf1a4e-f46c-42cb-8403-2012e9d5396c tempest-TestMinimumBasicScenario-709040934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:20:41 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-74a11419-1a26-4ad5-a069-38ad9d061598 req-4eaf1a4e-f46c-42cb-8403-2012e9d5396c tempest-TestMinimumBasicScenario-709040934 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-6b3da280-49c5-4027-8ff7-2281071743de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02b710a1-a245-41cc-bb96-170eb9853eb8', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:20:41 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-74a11419-1a26-4ad5-a069-38ad9d061598 req-4eaf1a4e-f46c-42cb-8403-2012e9d5396c tempest-TestMinimumBasicScenario-709040934 None] attachment_update completed successfully. Sep 23 15:20:51 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=45,cinder:UPDATE=59,cinder:INSERT=14,cinder:DELETE=5 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:20:51 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=50,cinder:UPDATE=57,cinder:INSERT=11,cinder:DELETE=6 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:20:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-dd2c1977-3aa3-4d9e-bf02-87b01d29d856 tempest-VolumesActionsTest-2064988386 None] Acquiring lock "cinder-c4e06729-78e6-44dc-87e4-0df86b469e57" by "attach_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:20:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-dd2c1977-3aa3-4d9e-bf02-87b01d29d856 tempest-VolumesActionsTest-2064988386 None] Lock "cinder-c4e06729-78e6-44dc-87e4-0df86b469e57" acquired by "attach_volume" :: waited 0.021s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:20:54 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-dd2c1977-3aa3-4d9e-bf02-87b01d29d856 tempest-VolumesActionsTest-2064988386 None] Attaching volume c4e06729-78e6-44dc-87e4-0df86b469e57 to instance 7133f833-1945-4f9b-a7c4-8091e4e882cc at mountpoint /dev/vdb on host None. Sep 23 15:20:54 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-dd2c1977-3aa3-4d9e-bf02-87b01d29d856 tempest-VolumesActionsTest-2064988386 None] Attach volume completed successfully. Sep 23 15:20:54 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-dd2c1977-3aa3-4d9e-bf02-87b01d29d856 tempest-VolumesActionsTest-2064988386 None] Lock "cinder-c4e06729-78e6-44dc-87e4-0df86b469e57" released by "attach_volume" :: held 0.135s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:20:54 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2f9ad545-3b46-4df9-b6a0-8224b6de8064 tempest-VolumesActionsTest-2064988386 None] Acquiring lock "cinder-c4e06729-78e6-44dc-87e4-0df86b469e57-detach_volume" by "detach_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:20:54 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2f9ad545-3b46-4df9-b6a0-8224b6de8064 tempest-VolumesActionsTest-2064988386 None] Lock "cinder-c4e06729-78e6-44dc-87e4-0df86b469e57-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:20:54 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-2f9ad545-3b46-4df9-b6a0-8224b6de8064 tempest-VolumesActionsTest-2064988386 None] Detaching volume c4e06729-78e6-44dc-87e4-0df86b469e57 from instance 7133f833-1945-4f9b-a7c4-8091e4e882cc. Sep 23 15:20:54 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-2f9ad545-3b46-4df9-b6a0-8224b6de8064 tempest-VolumesActionsTest-2064988386 None] Detach volume completed successfully. Sep 23 15:20:54 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2f9ad545-3b46-4df9-b6a0-8224b6de8064 tempest-VolumesActionsTest-2064988386 None] Lock "cinder-c4e06729-78e6-44dc-87e4-0df86b469e57-detach_volume" released by "detach_volume" :: held 0.120s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:20:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7487b590-8e3e-435e-90be-7e51f7f4bb12 tempest-VolumesActionsTest-2064988386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:20:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7487b590-8e3e-435e-90be-7e51f7f4bb12 tempest-VolumesActionsTest-2064988386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:20:59 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d564402-ba00-46f5-897b-24079b2c424f]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:20:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7487b590-8e3e-435e-90be-7e51f7f4bb12 tempest-VolumesActionsTest-2064988386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:59 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 Sep 23 15:20:59 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:20:59 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Sep 23 15:20:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7487b590-8e3e-435e-90be-7e51f7f4bb12 tempest-VolumesActionsTest-2064988386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57" returned: 0 in 0.395s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:20:59 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2cef82-0afc-4efc-9604-1ad4e47df416]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:20:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7487b590-8e3e-435e-90be-7e51f7f4bb12 tempest-VolumesActionsTest-2064988386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:20:59 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 Sep 23 15:20:59 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:00 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7487b590-8e3e-435e-90be-7e51f7f4bb12 tempest-VolumesActionsTest-2064988386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57" returned: 0 in 0.386s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7487b590-8e3e-435e-90be-7e51f7f4bb12 tempest-VolumesActionsTest-2064988386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 /opt/stack/data/cinder/conversion/c4e06729-78e6-44dc-87e4-0df86b469e57.temp_image.37068209-6c1a-4b23-9313-2bc9aabd31f5ia3wzw3r.img {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:00 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 /opt/stack/data/cinder/conversion/c4e06729-78e6-44dc-87e4-0df86b469e57.temp_image.37068209-6c1a-4b23-9313-2bc9aabd31f5ia3wzw3r.img Sep 23 15:21:00 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:04 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:21:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-aa0e289f-13d0-4e22-867d-6398f6387504 req-d6a57722-71fd-4067-8ab3-2c9b83239894 tempest-TestStampPattern-757802660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:21:08 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7487b590-8e3e-435e-90be-7e51f7f4bb12 tempest-VolumesActionsTest-2064988386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 /opt/stack/data/cinder/conversion/c4e06729-78e6-44dc-87e4-0df86b469e57.temp_image.37068209-6c1a-4b23-9313-2bc9aabd31f5ia3wzw3r.img" returned: 0 in 8.380s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:08 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b09aab-2421-4e01-9a4a-815e72b13d4e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:21:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7487b590-8e3e-435e-90be-7e51f7f4bb12 tempest-VolumesActionsTest-2064988386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:08 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 Sep 23 15:21:08 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:08 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7487b590-8e3e-435e-90be-7e51f7f4bb12 tempest-VolumesActionsTest-2064988386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57" returned: 0 in 0.544s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:08 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-7487b590-8e3e-435e-90be-7e51f7f4bb12 tempest-VolumesActionsTest-2064988386 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57, size 1024.00 MB, duration 8.38 sec, destination /opt/stack/data/cinder/conversion/c4e06729-78e6-44dc-87e4-0df86b469e57.temp_image.37068209-6c1a-4b23-9313-2bc9aabd31f5ia3wzw3r.img {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:21:08 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-7487b590-8e3e-435e-90be-7e51f7f4bb12 tempest-VolumesActionsTest-2064988386 None] Converted 1024.00 MB image at 122.18 MB/s Sep 23 15:21:09 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-7487b590-8e3e-435e-90be-7e51f7f4bb12 tempest-VolumesActionsTest-2064988386 None] 37068209-6c1a-4b23-9313-2bc9aabd31f5 was raw, no need to convert to raw {{(pid=86064) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 23 15:21:16 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=1 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:21:18 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:INSERT=1,cinder:SELECT=12,cinder:UPDATE=2 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:21:28 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-08cea772-781f-495a-a142-dff64b031efe req-ed1e2a08-293e-4c4e-98c7-47ecfddd3bcf tempest-TestMinimumBasicScenario-709040934 None] Terminate volume connection completed successfully. Sep 23 15:21:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-08cea772-781f-495a-a142-dff64b031efe req-ed1e2a08-293e-4c4e-98c7-47ecfddd3bcf tempest-TestMinimumBasicScenario-709040934 None] Deleting attachment 02b710a1-a245-41cc-bb96-170eb9853eb8. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:21:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7487b590-8e3e-435e-90be-7e51f7f4bb12 tempest-VolumesActionsTest-2064988386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.673s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:21:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7487b590-8e3e-435e-90be-7e51f7f4bb12 tempest-VolumesActionsTest-2064988386 None] Uploaded volume to glance image-id: 37068209-6c1a-4b23-9313-2bc9aabd31f5. {{(pid=86064) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 15:21:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-aa0e289f-13d0-4e22-867d-6398f6387504 req-d6a57722-71fd-4067-8ab3-2c9b83239894 tempest-TestStampPattern-757802660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 22.021s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:21:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-aa0e289f-13d0-4e22-867d-6398f6387504 req-d6a57722-71fd-4067-8ab3-2c9b83239894 tempest-TestStampPattern-757802660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:21:28 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7487b590-8e3e-435e-90be-7e51f7f4bb12 tempest-VolumesActionsTest-2064988386 None] Copy volume to image completed successfully. Sep 23 15:21:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-aa0e289f-13d0-4e22-867d-6398f6387504 req-d6a57722-71fd-4067-8ab3-2c9b83239894 tempest-TestStampPattern-757802660 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-87b68c37-42e3-4232-8775-c79538c4075e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6d3dde2-6120-4a12-8cad-a942c5712c66', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:21:28 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-aa0e289f-13d0-4e22-867d-6398f6387504 req-d6a57722-71fd-4067-8ab3-2c9b83239894 tempest-TestStampPattern-757802660 None] attachment_update completed successfully. Sep 23 15:21:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aa400287-7552-4265-91ec-d91a3fbd583c tempest-TestMinimumBasicScenario-709040934 None] Acquiring lock "cinder-6b3da280-49c5-4027-8ff7-2281071743de-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:21:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aa400287-7552-4265-91ec-d91a3fbd583c tempest-TestMinimumBasicScenario-709040934 None] Lock "cinder-6b3da280-49c5-4027-8ff7-2281071743de-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:21:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aa400287-7552-4265-91ec-d91a3fbd583c tempest-TestMinimumBasicScenario-709040934 None] Acquiring lock "cinder-quobyte-6b3da280-49c5-4027-8ff7-2281071743de" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:21:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aa400287-7552-4265-91ec-d91a3fbd583c tempest-TestMinimumBasicScenario-709040934 None] Lock "cinder-quobyte-6b3da280-49c5-4027-8ff7-2281071743de" acquired by "delete_volume" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:21:29 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1e9582-abb1-40a7-b7d7-a65feff236aa]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:21:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aa400287-7552-4265-91ec-d91a3fbd583c tempest-TestMinimumBasicScenario-709040934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6b3da280-49c5-4027-8ff7-2281071743de {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:29 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6b3da280-49c5-4027-8ff7-2281071743de Sep 23 15:21:29 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:30 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aa400287-7552-4265-91ec-d91a3fbd583c tempest-TestMinimumBasicScenario-709040934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6b3da280-49c5-4027-8ff7-2281071743de" returned: 0 in 0.410s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aa400287-7552-4265-91ec-d91a3fbd583c tempest-TestMinimumBasicScenario-709040934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6b3da280-49c5-4027-8ff7-2281071743de {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:30 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6b3da280-49c5-4027-8ff7-2281071743de Sep 23 15:21:30 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:30 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aa400287-7552-4265-91ec-d91a3fbd583c tempest-TestMinimumBasicScenario-709040934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6b3da280-49c5-4027-8ff7-2281071743de" returned: 0 in 0.284s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aa400287-7552-4265-91ec-d91a3fbd583c tempest-TestMinimumBasicScenario-709040934 None] Lock "cinder-quobyte-6b3da280-49c5-4027-8ff7-2281071743de" released by "delete_volume" :: held 0.752s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:21:30 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-aa400287-7552-4265-91ec-d91a3fbd583c tempest-TestMinimumBasicScenario-709040934 None] Created reservations ['c1b75188-e037-465b-b19b-f4041a3d0019', '14b09420-1d12-4f16-920e-24fe264b7430', 'd488aa6c-b871-4e92-bcaa-1243f45c46a8', '14373582-c357-4a51-b697-f314cb5da86b'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:21:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-aa400287-7552-4265-91ec-d91a3fbd583c tempest-TestMinimumBasicScenario-709040934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:21:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-aa400287-7552-4265-91ec-d91a3fbd583c tempest-TestMinimumBasicScenario-709040934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:21:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-aa400287-7552-4265-91ec-d91a3fbd583c tempest-TestMinimumBasicScenario-709040934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:21:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-aa400287-7552-4265-91ec-d91a3fbd583c tempest-TestMinimumBasicScenario-709040934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:21:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-aa400287-7552-4265-91ec-d91a3fbd583c tempest-TestMinimumBasicScenario-709040934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:21:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aa400287-7552-4265-91ec-d91a3fbd583c tempest-TestMinimumBasicScenario-709040934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:30 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:21:30 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:30 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:21:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:21:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aa400287-7552-4265-91ec-d91a3fbd583c tempest-TestMinimumBasicScenario-709040934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.330s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:30 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-aa400287-7552-4265-91ec-d91a3fbd583c tempest-TestMinimumBasicScenario-709040934 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:21:30 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-aa400287-7552-4265-91ec-d91a3fbd583c tempest-TestMinimumBasicScenario-709040934 None] Deleted volume successfully. Sep 23 15:21:30 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c063d5-e768-4fbe-b5f0-807aad372bea]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:21:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aa400287-7552-4265-91ec-d91a3fbd583c tempest-TestMinimumBasicScenario-709040934 None] Lock "cinder-6b3da280-49c5-4027-8ff7-2281071743de-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:21:31 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 Sep 23 15:21:31 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:31 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57" returned: 0 in 0.537s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:31 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fb48c4-6a33-4920-9a82-bfe2c1e0b433]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:21:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:31 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 Sep 23 15:21:31 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:32 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57" returned: 0 in 0.558s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 /opt/stack/data/cinder/conversion/c4e06729-78e6-44dc-87e4-0df86b469e57.temp_image.dcfc345b-2559-4855-b676-bdbfd87e6488pyyejt7i.img {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:32 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 /opt/stack/data/cinder/conversion/c4e06729-78e6-44dc-87e4-0df86b469e57.temp_image.dcfc345b-2559-4855-b676-bdbfd87e6488pyyejt7i.img Sep 23 15:21:32 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:35 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-a40818f9-bc93-4195-bd4d-a7ab03d34109 req-0eb2359d-e6c2-40eb-a1b6-e28b4222cbfa tempest-TestStampPattern-757802660 None] Terminate volume connection completed successfully. Sep 23 15:21:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-a40818f9-bc93-4195-bd4d-a7ab03d34109 req-0eb2359d-e6c2-40eb-a1b6-e28b4222cbfa tempest-TestStampPattern-757802660 None] Deleting attachment d6d3dde2-6120-4a12-8cad-a942c5712c66. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:21:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:21:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:21:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:21:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:21:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:21:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:21:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:36 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:21:36 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:36 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.773s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:21:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-df3ba682-4644-4847-896b-64502d8bc314 tempest-TestStampPattern-757802660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:21:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:21:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 28 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:21:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:21:40 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 /opt/stack/data/cinder/conversion/c4e06729-78e6-44dc-87e4-0df86b469e57.temp_image.dcfc345b-2559-4855-b676-bdbfd87e6488pyyejt7i.img" returned: 0 in 8.054s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:40 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7eab49-b72a-417f-a7da-292e77610b4a]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:21:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:40 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 Sep 23 15:21:40 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:40 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57" returned: 0 in 0.558s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:40 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57, size 1024.00 MB, duration 8.06 sec, destination /opt/stack/data/cinder/conversion/c4e06729-78e6-44dc-87e4-0df86b469e57.temp_image.dcfc345b-2559-4855-b676-bdbfd87e6488pyyejt7i.img {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:21:40 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] Converted 1024.00 MB image at 127.13 MB/s Sep 23 15:21:40 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] dcfc345b-2559-4855-b676-bdbfd87e6488 was raw, converting to qcow2 {{(pid=86064) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 23 15:21:40 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[519f3270-1e77-4776-95e4-4f6c0b9979c2]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:21:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c4e06729-78e6-44dc-87e4-0df86b469e57.temp_image.dcfc345b-2559-4855-b676-bdbfd87e6488pyyejt7i.img {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:40 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c4e06729-78e6-44dc-87e4-0df86b469e57.temp_image.dcfc345b-2559-4855-b676-bdbfd87e6488pyyejt7i.img Sep 23 15:21:40 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:41 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c4e06729-78e6-44dc-87e4-0df86b469e57.temp_image.dcfc345b-2559-4855-b676-bdbfd87e6488pyyejt7i.img" returned: 0 in 0.332s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c4e06729-78e6-44dc-87e4-0df86b469e57.temp_image.dcfc345b-2559-4855-b676-bdbfd87e6488pyyejt7i.img {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:41 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c4e06729-78e6-44dc-87e4-0df86b469e57.temp_image.dcfc345b-2559-4855-b676-bdbfd87e6488pyyejt7i.img Sep 23 15:21:41 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:41 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c4e06729-78e6-44dc-87e4-0df86b469e57.temp_image.dcfc345b-2559-4855-b676-bdbfd87e6488pyyejt7i.img" returned: 1 in 0.380s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c4e06729-78e6-44dc-87e4-0df86b469e57.temp_image.dcfc345b-2559-4855-b676-bdbfd87e6488pyyejt7i.img' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:21:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c4e06729-78e6-44dc-87e4-0df86b469e57.temp_image.dcfc345b-2559-4855-b676-bdbfd87e6488pyyejt7i.img /opt/stack/data/cinder/conversion/vol_upload_g466s7vk {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:41 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c4e06729-78e6-44dc-87e4-0df86b469e57.temp_image.dcfc345b-2559-4855-b676-bdbfd87e6488pyyejt7i.img /opt/stack/data/cinder/conversion/vol_upload_g466s7vk Sep 23 15:21:41 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:42 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c4e06729-78e6-44dc-87e4-0df86b469e57.temp_image.dcfc345b-2559-4855-b676-bdbfd87e6488pyyejt7i.img /opt/stack/data/cinder/conversion/vol_upload_g466s7vk" returned: 0 in 0.725s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:42 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] Image conversion details: src /opt/stack/data/cinder/conversion/c4e06729-78e6-44dc-87e4-0df86b469e57.temp_image.dcfc345b-2559-4855-b676-bdbfd87e6488pyyejt7i.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_g466s7vk {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:21:42 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 23 15:21:42 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30fa632-ec31-4ea3-ac55-421eadb79ff6]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:21:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_g466s7vk {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:42 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_g466s7vk Sep 23 15:21:42 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:42 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_g466s7vk" returned: 0 in 0.366s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.122s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:21:44 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] Uploaded volume to glance image-id: dcfc345b-2559-4855-b676-bdbfd87e6488. {{(pid=86064) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 15:21:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-df3ba682-4644-4847-896b-64502d8bc314 tempest-TestStampPattern-757802660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.139s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:21:44 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-df3ba682-4644-4847-896b-64502d8bc314 tempest-TestStampPattern-757802660 None] Creating offline snapshot c3346f20-a8d5-4aec-b7c4-2c772ded9a81 of volume 87b68c37-42e3-4232-8775-c79538c4075e {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:21:44 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-8f7c0d67-b275-4235-b2be-cc82a568daba tempest-VolumesActionsTest-2064988386 None] Copy volume to image completed successfully. Sep 23 15:21:44 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca69261-551a-4454-9443-489e9fe0f00d]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:21:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-df3ba682-4644-4847-896b-64502d8bc314 tempest-TestStampPattern-757802660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:44 devstack sudo[102698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e Sep 23 15:21:44 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:44 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-df3ba682-4644-4847-896b-64502d8bc314 tempest-TestStampPattern-757802660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e" returned: 0 in 0.389s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-df3ba682-4644-4847-896b-64502d8bc314 tempest-TestStampPattern-757802660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:44 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81 1G Sep 23 15:21:44 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:44 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-df3ba682-4644-4847-896b-64502d8bc314 tempest-TestStampPattern-757802660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81 1G" returned: 0 in 0.500s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-df3ba682-4644-4847-896b-64502d8bc314 tempest-TestStampPattern-757802660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b68c37-42e3-4232-8775-c79538c4075e -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:45 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b68c37-42e3-4232-8775-c79538c4075e -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81 Sep 23 15:21:45 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:45 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-df3ba682-4644-4847-896b-64502d8bc314 tempest-TestStampPattern-757802660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b68c37-42e3-4232-8775-c79538c4075e -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81" returned: 0 in 0.367s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:45 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-df3ba682-4644-4847-896b-64502d8bc314 tempest-TestStampPattern-757802660 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81 is being set with open permissions: ugo+rw Sep 23 15:21:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-df3ba682-4644-4847-896b-64502d8bc314 tempest-TestStampPattern-757802660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:45 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81 Sep 23 15:21:45 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-07673516-2fac-4132-a340-72de047ca684 tempest-VolumesActionsTest-2064988386 None] Acquiring lock "cinder-c4e06729-78e6-44dc-87e4-0df86b469e57-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:21:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-07673516-2fac-4132-a340-72de047ca684 tempest-VolumesActionsTest-2064988386 None] Lock "cinder-c4e06729-78e6-44dc-87e4-0df86b469e57-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:21:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-07673516-2fac-4132-a340-72de047ca684 tempest-VolumesActionsTest-2064988386 None] Acquiring lock "cinder-quobyte-c4e06729-78e6-44dc-87e4-0df86b469e57" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:21:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-07673516-2fac-4132-a340-72de047ca684 tempest-VolumesActionsTest-2064988386 None] Lock "cinder-quobyte-c4e06729-78e6-44dc-87e4-0df86b469e57" acquired by "delete_volume" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:21:45 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d3e5e4-1fba-48fb-a54c-f70daf7ee5b8]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:21:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-07673516-2fac-4132-a340-72de047ca684 tempest-VolumesActionsTest-2064988386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:45 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-df3ba682-4644-4847-896b-64502d8bc314 tempest-TestStampPattern-757802660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81" returned: 0 in 0.271s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-df3ba682-4644-4847-896b-64502d8bc314 tempest-TestStampPattern-757802660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:45 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 Sep 23 15:21:45 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:45 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.info Sep 23 15:21:45 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:45 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-07673516-2fac-4132-a340-72de047ca684 tempest-VolumesActionsTest-2064988386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57" returned: 0 in 0.374s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-07673516-2fac-4132-a340-72de047ca684 tempest-VolumesActionsTest-2064988386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:45 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-df3ba682-4644-4847-896b-64502d8bc314 tempest-TestStampPattern-757802660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.info" returned: 0 in 0.286s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:45 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-df3ba682-4644-4847-896b-64502d8bc314 tempest-TestStampPattern-757802660 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.info is being set with open permissions: ugo+rw Sep 23 15:21:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-df3ba682-4644-4847-896b-64502d8bc314 tempest-TestStampPattern-757802660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:45 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57 Sep 23 15:21:45 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:45 devstack sudo[102727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.info Sep 23 15:21:45 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:46 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-07673516-2fac-4132-a340-72de047ca684 tempest-VolumesActionsTest-2064988386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c4e06729-78e6-44dc-87e4-0df86b469e57" returned: 0 in 0.350s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:46 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-df3ba682-4644-4847-896b-64502d8bc314 tempest-TestStampPattern-757802660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.info" returned: 0 in 0.345s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-df3ba682-4644-4847-896b-64502d8bc314 tempest-TestStampPattern-757802660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.276s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:21:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-07673516-2fac-4132-a340-72de047ca684 tempest-VolumesActionsTest-2064988386 None] Lock "cinder-quobyte-c4e06729-78e6-44dc-87e4-0df86b469e57" released by "delete_volume" :: held 0.805s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:21:46 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-df3ba682-4644-4847-896b-64502d8bc314 tempest-TestStampPattern-757802660 None] Create snapshot completed successfully Sep 23 15:21:46 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-07673516-2fac-4132-a340-72de047ca684 tempest-VolumesActionsTest-2064988386 None] Created reservations ['817934d2-1b3d-4c28-9ad7-3e65e08fea4d', 'f2fa191a-a206-4b23-85ef-37228e150878', '6660af2b-b55b-4bb2-9b23-6e41c472d961', '1ea241c6-8583-41a4-a0be-8423cad6f729'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:21:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-07673516-2fac-4132-a340-72de047ca684 tempest-VolumesActionsTest-2064988386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:21:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-07673516-2fac-4132-a340-72de047ca684 tempest-VolumesActionsTest-2064988386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:21:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-07673516-2fac-4132-a340-72de047ca684 tempest-VolumesActionsTest-2064988386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:21:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-07673516-2fac-4132-a340-72de047ca684 tempest-VolumesActionsTest-2064988386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:21:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-07673516-2fac-4132-a340-72de047ca684 tempest-VolumesActionsTest-2064988386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:21:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-07673516-2fac-4132-a340-72de047ca684 tempest-VolumesActionsTest-2064988386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:46 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:21:46 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:46 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-07673516-2fac-4132-a340-72de047ca684 tempest-VolumesActionsTest-2064988386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.292s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:46 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-07673516-2fac-4132-a340-72de047ca684 tempest-VolumesActionsTest-2064988386 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:21:46 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-07673516-2fac-4132-a340-72de047ca684 tempest-VolumesActionsTest-2064988386 None] Deleted volume successfully. Sep 23 15:21:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-07673516-2fac-4132-a340-72de047ca684 tempest-VolumesActionsTest-2064988386 None] Lock "cinder-c4e06729-78e6-44dc-87e4-0df86b469e57-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:21:51 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:21:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Flow 'volume_create_manager' (5a89b0a3-4592-4674-8bb8-26b405a5f099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:21:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa3442d-5ed7-41f4-8a09-403812bdb3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa3442d-5ed7-41f4-8a09-403812bdb3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1148707627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca7003a3-7911-44c2-b430-2883c0a304cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a25b29f8644dcea840498c890c4569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:21:51Z,use_quota=True,user_id='a921071137b14e0ba07f65dff310c9b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b391ca45-2b6b-45ec-ad56-22c6e6e81032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b391ca45-2b6b-45ec-ad56-22c6e6e81032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52c7944-482f-404f-bf0a-80e44fe4ea96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52c7944-482f-404f-bf0a-80e44fe4ea96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca7003a3-7911-44c2-b430-2883c0a304cc', 'volume_name': 'volume-ca7003a3-7911-44c2-b430-2883c0a304cc', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (304295c3-72e1-4631-a7d4-56831bcd26bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (304295c3-72e1-4631-a7d4-56831bcd26bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178ceff4-3093-4c27-849d-8dbab42d6a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:51 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Volume ca7003a3-7911-44c2-b430-2883c0a304cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca7003a3-7911-44c2-b430-2883c0a304cc', 'volume_size': 1} Sep 23 15:21:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:21:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:21:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1148707627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca7003a3-7911-44c2-b430-2883c0a304cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a25b29f8644dcea840498c890c4569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:21:51Z,use_quota=True,user_id='a921071137b14e0ba07f65dff310c9b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:21:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Creating volume ca7003a3-7911-44c2-b430-2883c0a304cc {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:21:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:21:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:21:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:21:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:21:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:21:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:21:51 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:21:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ca7003a3-7911-44c2-b430-2883c0a304cc 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:51 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ca7003a3-7911-44c2-b430-2883c0a304cc 1073741824 Sep 23 15:21:51 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:52 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ca7003a3-7911-44c2-b430-2883c0a304cc 1073741824" returned: 0 in 0.604s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ca7003a3-7911-44c2-b430-2883c0a304cc {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:52 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ca7003a3-7911-44c2-b430-2883c0a304cc Sep 23 15:21:52 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:52 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ca7003a3-7911-44c2-b430-2883c0a304cc" returned: 0 in 0.294s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:21:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:21:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178ceff4-3093-4c27-849d-8dbab42d6a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca7003a3-7911-44c2-b430-2883c0a304cc', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d722bd16-b0b3-4140-8cdc-b13ae67213c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:52 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Volume volume-ca7003a3-7911-44c2-b430-2883c0a304cc (ca7003a3-7911-44c2-b430-2883c0a304cc): created successfully Sep 23 15:21:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d722bd16-b0b3-4140-8cdc-b13ae67213c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Flow 'volume_create_manager' (5a89b0a3-4592-4674-8bb8-26b405a5f099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:21:52 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-a6d13a25-75bc-42a8-8d84-942057bab001 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Created volume successfully. Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Flow 'volume_create_manager' (44a09a48-85ee-425d-a1f7-632d24bff1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b2d60c1-e600-4905-93d0-15271ee70743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b2d60c1-e600-4905-93d0-15271ee70743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1551570069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a25b29f8644dcea840498c890c4569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:21:54Z,use_quota=True,user_id='a921071137b14e0ba07f65dff310c9b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db943a71-069e-4bcd-b353-0a172cfcd84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db943a71-069e-4bcd-b353-0a172cfcd84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fbae348-e430-4efd-9e31-5fa30ba9b2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fbae348-e430-4efd-9e31-5fa30ba9b2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750', 'volume_name': 'volume-7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1eaa53b-cba9-409d-b0f4-9902f8a33a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1eaa53b-cba9-409d-b0f4-9902f8a33a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e71d14-43dd-4582-a8f9-0ee642c53161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:54 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Volume 7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750', 'volume_size': 1} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1551570069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a25b29f8644dcea840498c890c4569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:21:54Z,use_quota=True,user_id='a921071137b14e0ba07f65dff310c9b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Creating volume 7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:21:54 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:54 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750 1073741824 Sep 23 15:21:54 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Flow 'volume_create_manager' (a586df81-3521-467d-940f-184b6845e728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f8fa011-b5e5-4aab-a263-2f9aa8428f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f8fa011-b5e5-4aab-a263-2f9aa8428f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1921716437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea3638d2-38c1-4ca6-a6a4-d6387776f5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a25b29f8644dcea840498c890c4569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:21:55Z,use_quota=True,user_id='a921071137b14e0ba07f65dff310c9b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c2d76d-542b-4d88-b704-8e96215d7b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c2d76d-542b-4d88-b704-8e96215d7b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b14a011-ccf6-4f75-a123-6e33e3ad5dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b14a011-ccf6-4f75-a123-6e33e3ad5dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea3638d2-38c1-4ca6-a6a4-d6387776f5b6', 'volume_name': 'volume-ea3638d2-38c1-4ca6-a6a4-d6387776f5b6', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d819c0d-799c-4b68-9a57-4b90353d8828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d819c0d-799c-4b68-9a57-4b90353d8828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c9ede3-b0e0-4beb-b898-33bceba71e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:54 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Volume ea3638d2-38c1-4ca6-a6a4-d6387776f5b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea3638d2-38c1-4ca6-a6a4-d6387776f5b6', 'volume_size': 1} Sep 23 15:21:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:21:55 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750 1073741824" returned: 0 in 0.773s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:55 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750 Sep 23 15:21:55 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Flow 'volume_create_manager' (e48b2e6c-a953-417e-a806-a5ef33a79ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b0f45f-55d6-4d99-bc98-c150928a241b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:55 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750" returned: 0 in 0.386s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b0f45f-55d6-4d99-bc98-c150928a241b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-845190951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5bf5318-fa17-47e2-ad0b-33987a180a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a25b29f8644dcea840498c890c4569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:21:55Z,use_quota=True,user_id='a921071137b14e0ba07f65dff310c9b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2ad2ca-9bba-47e4-9532-a7893942085f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2ad2ca-9bba-47e4-9532-a7893942085f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55321de6-6970-41c2-b6a6-ebf8992fe152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55321de6-6970-41c2-b6a6-ebf8992fe152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5bf5318-fa17-47e2-ad0b-33987a180a3c', 'volume_name': 'volume-b5bf5318-fa17-47e2-ad0b-33987a180a3c', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a9d9a88-89d4-4c03-b1d6-21309df6aebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a9d9a88-89d4-4c03-b1d6-21309df6aebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f936826-ec96-417c-8ef5-1c607959a776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:55 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Volume b5bf5318-fa17-47e2-ad0b-33987a180a3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5bf5318-fa17-47e2-ad0b-33987a180a3c', 'volume_size': 1} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.556s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1921716437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea3638d2-38c1-4ca6-a6a4-d6387776f5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a25b29f8644dcea840498c890c4569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:21:55Z,use_quota=True,user_id='a921071137b14e0ba07f65dff310c9b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Creating volume ea3638d2-38c1-4ca6-a6a4-d6387776f5b6 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:21:55 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea3638d2-38c1-4ca6-a6a4-d6387776f5b6 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e71d14-43dd-4582-a8f9-0ee642c53161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f92cff3-fc36-4f51-b8e8-196924dae5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:55 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea3638d2-38c1-4ca6-a6a4-d6387776f5b6 1073741824 Sep 23 15:21:55 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:55 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Volume volume-7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750 (7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750): created successfully Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f92cff3-fc36-4f51-b8e8-196924dae5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Flow 'volume_create_manager' (44a09a48-85ee-425d-a1f7-632d24bff1b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:21:55 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-0ad98a34-c42e-4006-bd57-bc688790bdb4 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Created volume successfully. Sep 23 15:21:55 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Flow 'volume_create_manager' (5a58a815-1702-4ec7-b55a-ab4e34b271cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95982cd-1220-497b-b038-7e665b0daef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95982cd-1220-497b-b038-7e665b0daef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1213055688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d74b1e6-c13f-4097-b74b-7710a9408457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a25b29f8644dcea840498c890c4569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:21:56Z,use_quota=True,user_id='a921071137b14e0ba07f65dff310c9b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50cd0112-b9cf-4be9-a8b5-6e341c0d01bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50cd0112-b9cf-4be9-a8b5-6e341c0d01bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4f0d5e-14e5-484b-b7d2-a98887eb2574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4f0d5e-14e5-484b-b7d2-a98887eb2574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d74b1e6-c13f-4097-b74b-7710a9408457', 'volume_name': 'volume-5d74b1e6-c13f-4097-b74b-7710a9408457', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168a5995-eb38-4ef4-927b-081f2dcda9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168a5995-eb38-4ef4-927b-081f2dcda9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa27560-63d2-4796-8ee5-b64c7cf7ecf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:56 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Volume 5d74b1e6-c13f-4097-b74b-7710a9408457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d74b1e6-c13f-4097-b74b-7710a9408457', 'volume_size': 1} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:21:56 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea3638d2-38c1-4ca6-a6a4-d6387776f5b6 1073741824" returned: 0 in 0.640s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea3638d2-38c1-4ca6-a6a4-d6387776f5b6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:56 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea3638d2-38c1-4ca6-a6a4-d6387776f5b6 Sep 23 15:21:56 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:21:56 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Flow 'volume_create_manager' (2daa3915-5fec-4cd5-91bc-fdee48fb2d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d72e70a-da55-4e62-a604-5a6209b5dc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea3638d2-38c1-4ca6-a6a4-d6387776f5b6" returned: 0 in 0.390s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.095s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-845190951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5bf5318-fa17-47e2-ad0b-33987a180a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a25b29f8644dcea840498c890c4569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:21:55Z,use_quota=True,user_id='a921071137b14e0ba07f65dff310c9b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Creating volume b5bf5318-fa17-47e2-ad0b-33987a180a3c {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:21:56 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b5bf5318-fa17-47e2-ad0b-33987a180a3c 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d72e70a-da55-4e62-a604-5a6209b5dc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-450928676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6d79d4fcd644d1d970ba31df5d32760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:21:56Z,use_quota=True,user_id='6df570f06f4b470a97a1e9e59ce1a660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24566971-3919-400d-9119-9bebcd73015b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:56 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b5bf5318-fa17-47e2-ad0b-33987a180a3c 1073741824 Sep 23 15:21:56 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24566971-3919-400d-9119-9bebcd73015b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d576ccd-6b7a-4812-9460-2a64f7da61a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d576ccd-6b7a-4812-9460-2a64f7da61a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67', 'volume_name': 'volume-5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bfe4e02-faff-4053-a393-36a90784eeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bfe4e02-faff-4053-a393-36a90784eeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01791de0-d4e2-46e1-8d8f-bd079c77bbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:56 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Volume 5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67', 'volume_size': 1} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c9ede3-b0e0-4beb-b898-33bceba71e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea3638d2-38c1-4ca6-a6a4-d6387776f5b6', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7bb93d0-5619-4b67-93f9-20c9ac7d810e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Flow 'volume_create_manager' (2d6bbff8-1c28-4a7f-ae6f-18b0320972b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9120a446-34b6-4b59-b208-6c1123df7b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:56 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Volume volume-ea3638d2-38c1-4ca6-a6a4-d6387776f5b6 (ea3638d2-38c1-4ca6-a6a4-d6387776f5b6): created successfully Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7bb93d0-5619-4b67-93f9-20c9ac7d810e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Flow 'volume_create_manager' (a586df81-3521-467d-940f-184b6845e728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9120a446-34b6-4b59-b208-6c1123df7b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1047955715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3528227a-e9e3-44e4-b3ff-c7170e44e2d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a25b29f8644dcea840498c890c4569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:21:57Z,use_quota=True,user_id='a921071137b14e0ba07f65dff310c9b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d1fd5cb-2ecb-4a35-a48b-6c32e165075e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d1fd5cb-2ecb-4a35-a48b-6c32e165075e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a0cae5-46f4-4b2d-8f8c-d433fabdd980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a0cae5-46f4-4b2d-8f8c-d433fabdd980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3528227a-e9e3-44e4-b3ff-c7170e44e2d0', 'volume_name': 'volume-3528227a-e9e3-44e4-b3ff-c7170e44e2d0', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56041e15-f31d-494e-81ea-80a3ad30e1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56041e15-f31d-494e-81ea-80a3ad30e1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9449f97d-b685-45d2-b304-37ea30ff5d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:56 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Volume 3528227a-e9e3-44e4-b3ff-c7170e44e2d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3528227a-e9e3-44e4-b3ff-c7170e44e2d0', 'volume_size': 1} Sep 23 15:21:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:21:56 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-b174eef1-8cb7-48f2-988f-be2e2162fa3f tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Created volume successfully. Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Flow 'volume_create_manager' (80fbaa4b-e47d-433c-9195-4194a28a64f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a0f7e1-2be9-4107-86f1-251d38adefa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a0f7e1-2be9-4107-86f1-251d38adefa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-343755370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd277d65-db4d-4239-a41a-074a51dea68f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a93140b5114d46b35f9be166b9d694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c3346f20-a8d5-4aec-b7c4-2c772ded9a81,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:21:57Z,use_quota=True,user_id='8c820faec8164db28cf404081a081b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b17ec2-0068-4886-b751-2c06d86efb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b17ec2-0068-4886-b751-2c06d86efb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9dc1189-543f-4947-963d-fd1836a818ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9dc1189-543f-4947-963d-fd1836a818ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cd277d65-db4d-4239-a41a-074a51dea68f', 'volume_name': 'volume-cd277d65-db4d-4239-a41a-074a51dea68f', 'volume_size': 1, 'snapshot_id': 'c3346f20-a8d5-4aec-b7c4-2c772ded9a81'}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147b8e1a-8d48-4c33-aa9c-d2684a3074b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147b8e1a-8d48-4c33-aa9c-d2684a3074b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:57 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0537e238-ad6a-46ca-a5c3-8823486687ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:57 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Volume cd277d65-db4d-4239-a41a-074a51dea68f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cd277d65-db4d-4239-a41a-074a51dea68f', 'volume_size': 1, 'snapshot_id': 'c3346f20-a8d5-4aec-b7c4-2c772ded9a81'} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b5bf5318-fa17-47e2-ad0b-33987a180a3c 1073741824" returned: 0 in 0.563s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b5bf5318-fa17-47e2-ad0b-33987a180a3c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:57 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b5bf5318-fa17-47e2-ad0b-33987a180a3c Sep 23 15:21:57 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:57 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b5bf5318-fa17-47e2-ad0b-33987a180a3c" returned: 0 in 0.287s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.438s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1213055688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d74b1e6-c13f-4097-b74b-7710a9408457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a25b29f8644dcea840498c890c4569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:21:56Z,use_quota=True,user_id='a921071137b14e0ba07f65dff310c9b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Creating volume 5d74b1e6-c13f-4097-b74b-7710a9408457 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:21:57 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d74b1e6-c13f-4097-b74b-7710a9408457 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:57 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d74b1e6-c13f-4097-b74b-7710a9408457 1073741824 Sep 23 15:21:57 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f936826-ec96-417c-8ef5-1c607959a776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5bf5318-fa17-47e2-ad0b-33987a180a3c', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ea6795-fd7e-4b29-9b90-09a5973122bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:57 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Volume volume-b5bf5318-fa17-47e2-ad0b-33987a180a3c (b5bf5318-fa17-47e2-ad0b-33987a180a3c): created successfully Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ea6795-fd7e-4b29-9b90-09a5973122bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Flow 'volume_create_manager' (e48b2e6c-a953-417e-a806-a5ef33a79ac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:21:57 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-10c244cf-724e-4816-beba-58c52cee49d1 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Created volume successfully. Sep 23 15:21:58 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d74b1e6-c13f-4097-b74b-7710a9408457 1073741824" returned: 0 in 0.494s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d74b1e6-c13f-4097-b74b-7710a9408457 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:58 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d74b1e6-c13f-4097-b74b-7710a9408457 Sep 23 15:21:58 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:58 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d74b1e6-c13f-4097-b74b-7710a9408457" returned: 0 in 0.299s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:58 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:21:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:21:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.692s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:21:58 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-450928676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6d79d4fcd644d1d970ba31df5d32760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:21:56Z,use_quota=True,user_id='6df570f06f4b470a97a1e9e59ce1a660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:21:58 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Creating volume 5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:21:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:21:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:21:58 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:21:58 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:21:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:21:58 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:21:58 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:21:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:58 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa27560-63d2-4796-8ee5-b64c7cf7ecf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d74b1e6-c13f-4097-b74b-7710a9408457', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:58 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4431ee24-c885-4547-9f59-948a0933bcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:58 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67 1073741824 Sep 23 15:21:58 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:58 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Volume volume-5d74b1e6-c13f-4097-b74b-7710a9408457 (5d74b1e6-c13f-4097-b74b-7710a9408457): created successfully Sep 23 15:21:58 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4431ee24-c885-4547-9f59-948a0933bcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:58 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Flow 'volume_create_manager' (5a58a815-1702-4ec7-b55a-ab4e34b271cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:21:58 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-772f3afd-5d25-48de-9927-5261b221101c tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Created volume successfully. Sep 23 15:21:58 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67 1073741824" returned: 0 in 0.535s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:58 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67 Sep 23 15:21:58 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:59 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67" returned: 0 in 0.288s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:21:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:21:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:21:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.449s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:21:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1047955715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3528227a-e9e3-44e4-b3ff-c7170e44e2d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a25b29f8644dcea840498c890c4569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:21:57Z,use_quota=True,user_id='a921071137b14e0ba07f65dff310c9b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:21:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Creating volume 3528227a-e9e3-44e4-b3ff-c7170e44e2d0 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:21:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:21:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:21:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:21:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:21:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:21:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:21:59 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:21:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3528227a-e9e3-44e4-b3ff-c7170e44e2d0 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:21:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01791de0-d4e2-46e1-8d8f-bd079c77bbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c76095fc-059d-4fef-804c-2e4dd228c3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:21:59 devstack sudo[102845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3528227a-e9e3-44e4-b3ff-c7170e44e2d0 1073741824 Sep 23 15:21:59 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:21:59 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Volume volume-5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67 (5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67): created successfully Sep 23 15:21:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c76095fc-059d-4fef-804c-2e4dd228c3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:21:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Flow 'volume_create_manager' (2daa3915-5fec-4cd5-91bc-fdee48fb2d0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:21:59 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-350157dc-7fb4-47c2-96cd-c296009dee43 tempest-VolumesListTestJSON-2100941697 None] Created volume successfully. Sep 23 15:21:59 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root Sep 23 15:21:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3528227a-e9e3-44e4-b3ff-c7170e44e2d0 1073741824" returned: 0 in 0.683s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3528227a-e9e3-44e4-b3ff-c7170e44e2d0 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:00 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3528227a-e9e3-44e4-b3ff-c7170e44e2d0 Sep 23 15:22:00 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Flow 'volume_create_manager' (d0cce6e4-f200-439a-9fc1-248b1cbbf536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1794dc53-24ac-46d4-8979-3da989585a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1794dc53-24ac-46d4-8979-3da989585a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2047627952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d89415-8851-45d6-be70-4b4c9f46d9e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6d79d4fcd644d1d970ba31df5d32760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:22:00Z,use_quota=True,user_id='6df570f06f4b470a97a1e9e59ce1a660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3942b560-b15a-4c8f-985f-b1f220239974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3942b560-b15a-4c8f-985f-b1f220239974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b00360d-e879-4c23-84c8-8a944bc44381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b00360d-e879-4c23-84c8-8a944bc44381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87d89415-8851-45d6-be70-4b4c9f46d9e5', 'volume_name': 'volume-87d89415-8851-45d6-be70-4b4c9f46d9e5', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd35aa8e-5987-4b2a-bb61-213643a45601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd35aa8e-5987-4b2a-bb61-213643a45601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e4d598-2015-4994-beb9-82ddd24c21d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:00 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Volume 87d89415-8851-45d6-be70-4b4c9f46d9e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87d89415-8851-45d6-be70-4b4c9f46d9e5', 'volume_size': 1} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:00 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3528227a-e9e3-44e4-b3ff-c7170e44e2d0" returned: 0 in 0.492s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.329s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Acquiring lock "cinder-quobyte-c3346f20-a8d5-4aec-b7c4-2c772ded9a81-cd277d65-db4d-4239-a41a-074a51dea68f" by "_create_volume_from_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9449f97d-b685-45d2-b304-37ea30ff5d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3528227a-e9e3-44e4-b3ff-c7170e44e2d0', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c12624aa-1e10-4241-af11-8aa8cb1dcbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:00 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Volume volume-3528227a-e9e3-44e4-b3ff-c7170e44e2d0 (3528227a-e9e3-44e4-b3ff-c7170e44e2d0): created successfully Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c12624aa-1e10-4241-af11-8aa8cb1dcbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Flow 'volume_create_manager' (2d6bbff8-1c28-4a7f-ae6f-18b0320972b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Lock "cinder-quobyte-c3346f20-a8d5-4aec-b7c4-2c772ded9a81-cd277d65-db4d-4239-a41a-074a51dea68f" acquired by "_create_volume_from_snapshot" :: waited 0.075s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Creating volume cd277d65-db4d-4239-a41a-074a51dea68f from snapshot c3346f20-a8d5-4aec-b7c4-2c772ded9a81 {{(pid=86064) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Acquiring lock "cinder-quobyte-cd277d65-db4d-4239-a41a-074a51dea68f" by "_copy_volume_from_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:00 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-676f4c78-a010-45db-b3d0-768e638737eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Created volume successfully. Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Lock "cinder-quobyte-cd277d65-db4d-4239-a41a-074a51dea68f" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] snapshot: c3346f20-a8d5-4aec-b7c4-2c772ded9a81, volume: cd277d65-db4d-4239-a41a-074a51dea68f, {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58385f1-8bc1-468e-8361-4dce9ae0216c]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:00 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81 Sep 23 15:22:00 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:01 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2ad73f9e-af72-469f-9f51-ddf0f1baf7a2 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "cinder-3528227a-e9e3-44e4-b3ff-c7170e44e2d0-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:01 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2ad73f9e-af72-469f-9f51-ddf0f1baf7a2 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-3528227a-e9e3-44e4-b3ff-c7170e44e2d0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:01 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2ad73f9e-af72-469f-9f51-ddf0f1baf7a2 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "cinder-quobyte-3528227a-e9e3-44e4-b3ff-c7170e44e2d0" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:01 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2ad73f9e-af72-469f-9f51-ddf0f1baf7a2 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-quobyte-3528227a-e9e3-44e4-b3ff-c7170e44e2d0" acquired by "delete_volume" :: waited 0.041s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:01 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81" returned: 0 in 0.634s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87b68c37-42e3-4232-8775-c79538c4075e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:22:01 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6e4558-f8f8-4d5d-a952-8903a2ce1308]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:01 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c732a2a3-5ebe-4be9-98b2-2f5fd9d55ae5]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2ad73f9e-af72-469f-9f51-ddf0f1baf7a2 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3528227a-e9e3-44e4-b3ff-c7170e44e2d0 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:01 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e Sep 23 15:22:01 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:01 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3528227a-e9e3-44e4-b3ff-c7170e44e2d0 Sep 23 15:22:01 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:01 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e" returned: 0 in 0.475s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 15:22:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Creating direct copy from snapshot {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 15:22:01 devstack cinder-volume[86064]: DEBUG cinder.utils [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Path /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd277d65-db4d-4239-a41a-074a51dea68f not found in is_blk_device check {{(pid=86064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 15:22:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd277d65-db4d-4239-a41a-074a51dea68f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:01 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd277d65-db4d-4239-a41a-074a51dea68f Sep 23 15:22:01 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:01 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2ad73f9e-af72-469f-9f51-ddf0f1baf7a2 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3528227a-e9e3-44e4-b3ff-c7170e44e2d0" returned: 0 in 0.558s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2ad73f9e-af72-469f-9f51-ddf0f1baf7a2 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3528227a-e9e3-44e4-b3ff-c7170e44e2d0 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:02 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3528227a-e9e3-44e4-b3ff-c7170e44e2d0 Sep 23 15:22:02 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:02 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2ad73f9e-af72-469f-9f51-ddf0f1baf7a2 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3528227a-e9e3-44e4-b3ff-c7170e44e2d0" returned: 0 in 0.445s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:02 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2ad73f9e-af72-469f-9f51-ddf0f1baf7a2 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-quobyte-3528227a-e9e3-44e4-b3ff-c7170e44e2d0" released by "delete_volume" :: held 1.102s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:02 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-2ad73f9e-af72-469f-9f51-ddf0f1baf7a2 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Created reservations ['85919895-dbca-4206-9bb7-798d1975b36a', 'a51f96e0-9ebd-4a6d-a1f9-b232fa6eb9e6', '74c47c17-a7ef-4a3c-8efc-040d104a16a2', '73e8b3ef-1a9e-4766-8292-be824fd57343'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:22:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2ad73f9e-af72-469f-9f51-ddf0f1baf7a2 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2ad73f9e-af72-469f-9f51-ddf0f1baf7a2 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2ad73f9e-af72-469f-9f51-ddf0f1baf7a2 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2ad73f9e-af72-469f-9f51-ddf0f1baf7a2 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2ad73f9e-af72-469f-9f51-ddf0f1baf7a2 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2ad73f9e-af72-469f-9f51-ddf0f1baf7a2 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:02 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:22:02 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:03 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2ad73f9e-af72-469f-9f51-ddf0f1baf7a2 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.529s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:03 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-2ad73f9e-af72-469f-9f51-ddf0f1baf7a2 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:22:03 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-2ad73f9e-af72-469f-9f51-ddf0f1baf7a2 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Deleted volume successfully. Sep 23 15:22:03 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2ad73f9e-af72-469f-9f51-ddf0f1baf7a2 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-3528227a-e9e3-44e4-b3ff-c7170e44e2d0-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:03 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d6c908da-87b2-4b37-b6e3-9ba528370546 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "cinder-5d74b1e6-c13f-4097-b74b-7710a9408457-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:03 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d6c908da-87b2-4b37-b6e3-9ba528370546 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-5d74b1e6-c13f-4097-b74b-7710a9408457-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:03 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d6c908da-87b2-4b37-b6e3-9ba528370546 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "cinder-quobyte-5d74b1e6-c13f-4097-b74b-7710a9408457" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:03 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d6c908da-87b2-4b37-b6e3-9ba528370546 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-quobyte-5d74b1e6-c13f-4097-b74b-7710a9408457" acquired by "delete_volume" :: waited 0.021s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:03 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91a4fa2-fba1-41a8-a361-d5992622def3]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d6c908da-87b2-4b37-b6e3-9ba528370546 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d74b1e6-c13f-4097-b74b-7710a9408457 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:04 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d74b1e6-c13f-4097-b74b-7710a9408457 Sep 23 15:22:04 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d6c908da-87b2-4b37-b6e3-9ba528370546 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d74b1e6-c13f-4097-b74b-7710a9408457" returned: 0 in 0.740s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d6c908da-87b2-4b37-b6e3-9ba528370546 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d74b1e6-c13f-4097-b74b-7710a9408457 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:04 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:04 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d74b1e6-c13f-4097-b74b-7710a9408457 Sep 23 15:22:04 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:05 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d6c908da-87b2-4b37-b6e3-9ba528370546 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5d74b1e6-c13f-4097-b74b-7710a9408457" returned: 0 in 0.885s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:05 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d6c908da-87b2-4b37-b6e3-9ba528370546 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-quobyte-5d74b1e6-c13f-4097-b74b-7710a9408457" released by "delete_volume" :: held 1.732s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:05 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-d6c908da-87b2-4b37-b6e3-9ba528370546 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Created reservations ['da6cc8ea-de7b-4f54-aa75-e58099e5718e', '16082658-5521-49bb-83b4-fb0b36d7e886', '130554fd-8a2b-4045-b7bb-eec8c55443ee', '347a7d47-8705-4953-88e4-f4b1e1fb71cf'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:22:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d6c908da-87b2-4b37-b6e3-9ba528370546 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d6c908da-87b2-4b37-b6e3-9ba528370546 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d6c908da-87b2-4b37-b6e3-9ba528370546 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d6c908da-87b2-4b37-b6e3-9ba528370546 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d6c908da-87b2-4b37-b6e3-9ba528370546 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d6c908da-87b2-4b37-b6e3-9ba528370546 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:06 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:22:06 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:06 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d6c908da-87b2-4b37-b6e3-9ba528370546 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.727s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:06 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-d6c908da-87b2-4b37-b6e3-9ba528370546 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:22:06 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-d6c908da-87b2-4b37-b6e3-9ba528370546 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Deleted volume successfully. Sep 23 15:22:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d6c908da-87b2-4b37-b6e3-9ba528370546 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-5d74b1e6-c13f-4097-b74b-7710a9408457-delete_volume" released by "delete_volume" :: held 3.110s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8728b82a-8abc-49b1-9ff3-f41e4c27c1c6 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "cinder-b5bf5318-fa17-47e2-ad0b-33987a180a3c-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8728b82a-8abc-49b1-9ff3-f41e4c27c1c6 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-b5bf5318-fa17-47e2-ad0b-33987a180a3c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:07 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8728b82a-8abc-49b1-9ff3-f41e4c27c1c6 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "cinder-quobyte-b5bf5318-fa17-47e2-ad0b-33987a180a3c" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:07 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8728b82a-8abc-49b1-9ff3-f41e4c27c1c6 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-quobyte-b5bf5318-fa17-47e2-ad0b-33987a180a3c" acquired by "delete_volume" :: waited 0.056s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:07 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48bcd1d-1f57-4af3-b89a-a9541dcbc59b]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8728b82a-8abc-49b1-9ff3-f41e4c27c1c6 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b5bf5318-fa17-47e2-ad0b-33987a180a3c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:07 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b5bf5318-fa17-47e2-ad0b-33987a180a3c Sep 23 15:22:07 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:08 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8728b82a-8abc-49b1-9ff3-f41e4c27c1c6 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b5bf5318-fa17-47e2-ad0b-33987a180a3c" returned: 0 in 1.100s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8728b82a-8abc-49b1-9ff3-f41e4c27c1c6 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b5bf5318-fa17-47e2-ad0b-33987a180a3c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:08 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b5bf5318-fa17-47e2-ad0b-33987a180a3c Sep 23 15:22:08 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:09 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8728b82a-8abc-49b1-9ff3-f41e4c27c1c6 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-b5bf5318-fa17-47e2-ad0b-33987a180a3c" returned: 0 in 0.804s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:09 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8728b82a-8abc-49b1-9ff3-f41e4c27c1c6 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-quobyte-b5bf5318-fa17-47e2-ad0b-33987a180a3c" released by "delete_volume" :: held 2.090s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:09 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-8728b82a-8abc-49b1-9ff3-f41e4c27c1c6 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Created reservations ['a57bdfda-7fc4-4e49-a790-bf5689b061d1', 'f8d3261d-86f0-4b89-81e8-4de31a4b0d7a', 'bac193f1-259b-431b-ad19-cdc9393fd100', 'f808b8ea-d05b-4433-b0d7-934a7418bbb4'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:22:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8728b82a-8abc-49b1-9ff3-f41e4c27c1c6 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8728b82a-8abc-49b1-9ff3-f41e4c27c1c6 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:09 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8728b82a-8abc-49b1-9ff3-f41e4c27c1c6 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:09 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8728b82a-8abc-49b1-9ff3-f41e4c27c1c6 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8728b82a-8abc-49b1-9ff3-f41e4c27c1c6 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8728b82a-8abc-49b1-9ff3-f41e4c27c1c6 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:09 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:22:09 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:10 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8728b82a-8abc-49b1-9ff3-f41e4c27c1c6 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.921s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:10 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-8728b82a-8abc-49b1-9ff3-f41e4c27c1c6 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:22:10 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-8728b82a-8abc-49b1-9ff3-f41e4c27c1c6 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Deleted volume successfully. Sep 23 15:22:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8728b82a-8abc-49b1-9ff3-f41e4c27c1c6 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-b5bf5318-fa17-47e2-ad0b-33987a180a3c-delete_volume" released by "delete_volume" :: held 3.823s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-36a35e61-79a2-4c0e-8f6b-24c9a5d07b22 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "cinder-ea3638d2-38c1-4ca6-a6a4-d6387776f5b6-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-36a35e61-79a2-4c0e-8f6b-24c9a5d07b22 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-ea3638d2-38c1-4ca6-a6a4-d6387776f5b6-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:11 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-36a35e61-79a2-4c0e-8f6b-24c9a5d07b22 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "cinder-quobyte-ea3638d2-38c1-4ca6-a6a4-d6387776f5b6" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:11 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-36a35e61-79a2-4c0e-8f6b-24c9a5d07b22 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-quobyte-ea3638d2-38c1-4ca6-a6a4-d6387776f5b6" acquired by "delete_volume" :: waited 0.032s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:11 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b46a36-3975-4373-8ca9-44ddeda712d6]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-36a35e61-79a2-4c0e-8f6b-24c9a5d07b22 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea3638d2-38c1-4ca6-a6a4-d6387776f5b6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:11 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea3638d2-38c1-4ca6-a6a4-d6387776f5b6 Sep 23 15:22:11 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:12 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-36a35e61-79a2-4c0e-8f6b-24c9a5d07b22 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea3638d2-38c1-4ca6-a6a4-d6387776f5b6" returned: 0 in 0.917s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-36a35e61-79a2-4c0e-8f6b-24c9a5d07b22 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea3638d2-38c1-4ca6-a6a4-d6387776f5b6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:12 devstack sudo[102993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea3638d2-38c1-4ca6-a6a4-d6387776f5b6 Sep 23 15:22:12 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:12 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-36a35e61-79a2-4c0e-8f6b-24c9a5d07b22 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ea3638d2-38c1-4ca6-a6a4-d6387776f5b6" returned: 0 in 0.727s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-36a35e61-79a2-4c0e-8f6b-24c9a5d07b22 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-quobyte-ea3638d2-38c1-4ca6-a6a4-d6387776f5b6" released by "delete_volume" :: held 1.783s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-36a35e61-79a2-4c0e-8f6b-24c9a5d07b22 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Created reservations ['981f506f-8a42-40f8-91f6-8c47a0807978', 'bbd677bf-9360-42f6-a616-214d72476595', 'f680e4e6-e1b3-4411-9d08-5a521e2b1b3e', 'cee5d9f2-f51d-426f-b5d3-6246de9b2ef7'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-36a35e61-79a2-4c0e-8f6b-24c9a5d07b22 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-36a35e61-79a2-4c0e-8f6b-24c9a5d07b22 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-36a35e61-79a2-4c0e-8f6b-24c9a5d07b22 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-36a35e61-79a2-4c0e-8f6b-24c9a5d07b22 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-36a35e61-79a2-4c0e-8f6b-24c9a5d07b22 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-36a35e61-79a2-4c0e-8f6b-24c9a5d07b22 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:13 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:22:13 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:13 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd277d65-db4d-4239-a41a-074a51dea68f" returned: 0 in 11.363s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e, size 1024.00 MB, duration 11.37 sec, destination /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd277d65-db4d-4239-a41a-074a51dea68f {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:22:13 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Converted 1024.00 MB image at 90.10 MB/s Sep 23 15:22:13 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd277d65-db4d-4239-a41a-074a51dea68f is being set with open permissions: ugo+rw Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd277d65-db4d-4239-a41a-074a51dea68f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b97166e1-4a5f-40f9-88b9-2a84fecbd9eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "cinder-7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:13 devstack sudo[102998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd277d65-db4d-4239-a41a-074a51dea68f Sep 23 15:22:13 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b97166e1-4a5f-40f9-88b9-2a84fecbd9eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b97166e1-4a5f-40f9-88b9-2a84fecbd9eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "cinder-quobyte-7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b97166e1-4a5f-40f9-88b9-2a84fecbd9eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-quobyte-7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750" acquired by "delete_volume" :: waited 0.027s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[19efb077-c79f-49bc-bf75-4a69a2ae2aa7]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b97166e1-4a5f-40f9-88b9-2a84fecbd9eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:13 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-36a35e61-79a2-4c0e-8f6b-24c9a5d07b22 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.435s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-36a35e61-79a2-4c0e-8f6b-24c9a5d07b22 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:22:13 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-36a35e61-79a2-4c0e-8f6b-24c9a5d07b22 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Deleted volume successfully. Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-36a35e61-79a2-4c0e-8f6b-24c9a5d07b22 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-ea3638d2-38c1-4ca6-a6a4-d6387776f5b6-delete_volume" released by "delete_volume" :: held 2.810s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:13 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd277d65-db4d-4239-a41a-074a51dea68f" returned: 0 in 0.452s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Lock "cinder-quobyte-cd277d65-db4d-4239-a41a-074a51dea68f" released by "_copy_volume_from_snapshot" :: held 13.068s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:13 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750 Sep 23 15:22:13 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Lock "cinder-quobyte-c3346f20-a8d5-4aec-b7c4-2c772ded9a81-cd277d65-db4d-4239-a41a-074a51dea68f" released by "_create_volume_from_snapshot" :: held 13.188s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.268s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.367s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2047627952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d89415-8851-45d6-be70-4b4c9f46d9e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6d79d4fcd644d1d970ba31df5d32760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:22:00Z,use_quota=True,user_id='6df570f06f4b470a97a1e9e59ce1a660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Creating volume 87d89415-8851-45d6-be70-4b4c9f46d9e5 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:22:13 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87d89415-8851-45d6-be70-4b4c9f46d9e5 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:13 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87d89415-8851-45d6-be70-4b4c9f46d9e5 1073741824 Sep 23 15:22:13 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0537e238-ad6a-46ca-a5c3-8823486687ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd277d65-db4d-4239-a41a-074a51dea68f', 'volume_size': 1, 'snapshot_id': 'c3346f20-a8d5-4aec-b7c4-2c772ded9a81'}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8f9aca2-6e6e-444d-8151-056ca96d8ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:13 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Volume volume-cd277d65-db4d-4239-a41a-074a51dea68f (cd277d65-db4d-4239-a41a-074a51dea68f): created successfully Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8f9aca2-6e6e-444d-8151-056ca96d8ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Flow 'volume_create_manager' (80fbaa4b-e47d-433c-9195-4194a28a64f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:22:13 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-bdd1a3cd-2bde-478d-81ab-2d69af602519 tempest-TestStampPattern-757802660 None] Created volume successfully. Sep 23 15:22:14 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b97166e1-4a5f-40f9-88b9-2a84fecbd9eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750" returned: 0 in 0.653s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b97166e1-4a5f-40f9-88b9-2a84fecbd9eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:14 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750 Sep 23 15:22:14 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:14 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87d89415-8851-45d6-be70-4b4c9f46d9e5 1073741824" returned: 0 in 0.653s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:14 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b97166e1-4a5f-40f9-88b9-2a84fecbd9eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750" returned: 0 in 0.347s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87d89415-8851-45d6-be70-4b4c9f46d9e5 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b97166e1-4a5f-40f9-88b9-2a84fecbd9eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-quobyte-7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750" released by "delete_volume" :: held 1.089s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:14 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87d89415-8851-45d6-be70-4b4c9f46d9e5 Sep 23 15:22:14 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:14 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-b97166e1-4a5f-40f9-88b9-2a84fecbd9eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Created reservations ['e1e788d7-0086-4fc1-8a2f-d128c134f989', '27ce1b48-3cf0-4fa6-b298-f209ecc9cb91', '2aad98ab-c5e7-4190-adc4-e4557a55c5f1', '92f97616-3f20-4310-a18a-7716705f1c8e'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:22:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b97166e1-4a5f-40f9-88b9-2a84fecbd9eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b97166e1-4a5f-40f9-88b9-2a84fecbd9eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b97166e1-4a5f-40f9-88b9-2a84fecbd9eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b97166e1-4a5f-40f9-88b9-2a84fecbd9eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b97166e1-4a5f-40f9-88b9-2a84fecbd9eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b97166e1-4a5f-40f9-88b9-2a84fecbd9eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:14 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:22:14 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:14 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87d89415-8851-45d6-be70-4b4c9f46d9e5" returned: 0 in 0.410s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:22:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e4d598-2015-4994-beb9-82ddd24c21d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87d89415-8851-45d6-be70-4b4c9f46d9e5', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d040f7ea-7944-46c1-84fd-d7ef57d4fe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:15 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Volume volume-87d89415-8851-45d6-be70-4b4c9f46d9e5 (87d89415-8851-45d6-be70-4b4c9f46d9e5): created successfully Sep 23 15:22:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d040f7ea-7944-46c1-84fd-d7ef57d4fe41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Flow 'volume_create_manager' (d0cce6e4-f200-439a-9fc1-248b1cbbf536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:22:15 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-0e4aaba9-6086-4483-8c51-c4911261d841 tempest-VolumesListTestJSON-2100941697 None] Created volume successfully. Sep 23 15:22:15 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b97166e1-4a5f-40f9-88b9-2a84fecbd9eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.317s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:15 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-b97166e1-4a5f-40f9-88b9-2a84fecbd9eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:22:15 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-b97166e1-4a5f-40f9-88b9-2a84fecbd9eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Deleted volume successfully. Sep 23 15:22:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b97166e1-4a5f-40f9-88b9-2a84fecbd9eb tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-7b41f6c2-29a4-4b3a-8ae9-8b6beb1e0750-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e8e2e231-8144-478d-a751-011518dc67e7 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "cinder-ca7003a3-7911-44c2-b430-2883c0a304cc-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e8e2e231-8144-478d-a751-011518dc67e7 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-ca7003a3-7911-44c2-b430-2883c0a304cc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e8e2e231-8144-478d-a751-011518dc67e7 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "cinder-quobyte-ca7003a3-7911-44c2-b430-2883c0a304cc" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e8e2e231-8144-478d-a751-011518dc67e7 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-quobyte-ca7003a3-7911-44c2-b430-2883c0a304cc" acquired by "delete_volume" :: waited 0.031s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:15 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b6c96f-2114-4727-9b40-83e517438536]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e8e2e231-8144-478d-a751-011518dc67e7 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ca7003a3-7911-44c2-b430-2883c0a304cc {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Flow 'volume_create_manager' (1b0ebf86-e65d-4d10-9678-3e9c4be8cbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f5f793b-3297-46c4-9f3b-8ead45b57d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:16 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ca7003a3-7911-44c2-b430-2883c0a304cc Sep 23 15:22:16 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f5f793b-3297-46c4-9f3b-8ead45b57d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-775464374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b82bc6-b484-4666-a2ce-7d90195c2eac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6d79d4fcd644d1d970ba31df5d32760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:22:16Z,use_quota=True,user_id='6df570f06f4b470a97a1e9e59ce1a660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a4be5a-6df8-4f27-ac7f-04e2e1c1a521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a4be5a-6df8-4f27-ac7f-04e2e1c1a521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd13a3b-ec57-43e8-89e0-bf4e129da844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd13a3b-ec57-43e8-89e0-bf4e129da844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5b82bc6-b484-4666-a2ce-7d90195c2eac', 'volume_name': 'volume-a5b82bc6-b484-4666-a2ce-7d90195c2eac', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efaa895b-9a7a-4e9e-8ed6-6bc40fe43c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efaa895b-9a7a-4e9e-8ed6-6bc40fe43c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21430bfe-3d27-490e-90fe-3384434d372f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:16 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Volume a5b82bc6-b484-4666-a2ce-7d90195c2eac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5b82bc6-b484-4666-a2ce-7d90195c2eac', 'volume_size': 1} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-775464374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b82bc6-b484-4666-a2ce-7d90195c2eac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6d79d4fcd644d1d970ba31df5d32760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:22:16Z,use_quota=True,user_id='6df570f06f4b470a97a1e9e59ce1a660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Creating volume a5b82bc6-b484-4666-a2ce-7d90195c2eac {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:22:16 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5b82bc6-b484-4666-a2ce-7d90195c2eac 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:16 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5b82bc6-b484-4666-a2ce-7d90195c2eac 1073741824 Sep 23 15:22:16 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:16 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e8e2e231-8144-478d-a751-011518dc67e7 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ca7003a3-7911-44c2-b430-2883c0a304cc" returned: 0 in 0.449s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e8e2e231-8144-478d-a751-011518dc67e7 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ca7003a3-7911-44c2-b430-2883c0a304cc {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:16 devstack sudo[103031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ca7003a3-7911-44c2-b430-2883c0a304cc Sep 23 15:22:16 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:16 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5b82bc6-b484-4666-a2ce-7d90195c2eac 1073741824" returned: 0 in 0.511s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:16 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e8e2e231-8144-478d-a751-011518dc67e7 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ca7003a3-7911-44c2-b430-2883c0a304cc" returned: 0 in 0.305s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e8e2e231-8144-478d-a751-011518dc67e7 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-quobyte-ca7003a3-7911-44c2-b430-2883c0a304cc" released by "delete_volume" :: held 0.869s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5b82bc6-b484-4666-a2ce-7d90195c2eac {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:16 devstack sudo[103039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5b82bc6-b484-4666-a2ce-7d90195c2eac Sep 23 15:22:16 devstack sudo[103039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-e8e2e231-8144-478d-a751-011518dc67e7 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Created reservations ['6c74770b-de1d-4daa-97c1-fb61fd66ade7', 'bdbfbc3b-fa9d-41e6-9fab-c32622e5be07', 'ff002f63-7b15-496a-a00d-d3c9bf6a86e1', '39a7fc80-6e49-4dc7-b68c-8858053a9391'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e8e2e231-8144-478d-a751-011518dc67e7 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e8e2e231-8144-478d-a751-011518dc67e7 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e8e2e231-8144-478d-a751-011518dc67e7 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e8e2e231-8144-478d-a751-011518dc67e7 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e8e2e231-8144-478d-a751-011518dc67e7 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e8e2e231-8144-478d-a751-011518dc67e7 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:16 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:22:16 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:17 devstack sudo[103039]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5b82bc6-b484-4666-a2ce-7d90195c2eac" returned: 0 in 0.399s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:22:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21430bfe-3d27-490e-90fe-3384434d372f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5b82bc6-b484-4666-a2ce-7d90195c2eac', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5afe2e5-4d9a-40af-8b11-c12d48abaee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:17 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Volume volume-a5b82bc6-b484-4666-a2ce-7d90195c2eac (a5b82bc6-b484-4666-a2ce-7d90195c2eac): created successfully Sep 23 15:22:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5afe2e5-4d9a-40af-8b11-c12d48abaee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Flow 'volume_create_manager' (1b0ebf86-e65d-4d10-9678-3e9c4be8cbc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:22:17 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-0cd7535d-a989-49f6-8fac-83fb5c230924 tempest-VolumesListTestJSON-2100941697 None] Created volume successfully. Sep 23 15:22:17 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e8e2e231-8144-478d-a751-011518dc67e7 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.332s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:17 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-e8e2e231-8144-478d-a751-011518dc67e7 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:22:17 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-e8e2e231-8144-478d-a751-011518dc67e7 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Deleted volume successfully. Sep 23 15:22:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e8e2e231-8144-478d-a751-011518dc67e7 tempest-CreateVolumesFromSourceVolumeTest-916873607 None] Lock "cinder-ca7003a3-7911-44c2-b430-2883c0a304cc-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=77,cinder:UPDATE=103,cinder:INSERT=22,cinder:DELETE=14 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Flow 'volume_create_manager' (a5a766da-ed5b-4a75-ad62-caa4bdf1551d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a9ef4d-5db9-45e9-b7da-eec88fd9ff60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a9ef4d-5db9-45e9-b7da-eec88fd9ff60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-372941172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c57318e-e802-4c6d-8af1-9602a476fea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843d05739c8e42f49fe3bafd68cbb7fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:22:20Z,use_quota=True,user_id='a66886720fe14ca587fb30df90a43949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2414bd8d-0452-46eb-b0c5-cafd72e0e667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2414bd8d-0452-46eb-b0c5-cafd72e0e667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d00ffc-d428-4e34-ab4b-942de59abfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d00ffc-d428-4e34-ab4b-942de59abfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c57318e-e802-4c6d-8af1-9602a476fea2', 'volume_name': 'volume-6c57318e-e802-4c6d-8af1-9602a476fea2', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f74babf-d50d-4fd0-8682-6187e5a21029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f74babf-d50d-4fd0-8682-6187e5a21029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50e6f2d-67a3-438e-9aba-8c177bb37d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:20 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Volume 6c57318e-e802-4c6d-8af1-9602a476fea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c57318e-e802-4c6d-8af1-9602a476fea2', 'volume_size': 1} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-372941172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c57318e-e802-4c6d-8af1-9602a476fea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843d05739c8e42f49fe3bafd68cbb7fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:22:20Z,use_quota=True,user_id='a66886720fe14ca587fb30df90a43949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Creating volume 6c57318e-e802-4c6d-8af1-9602a476fea2 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:22:20 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8f5caf29-148c-430d-94d9-debee6c870f0 tempest-VolumesListTestJSON-2100941697 None] Acquiring lock "cinder-a5b82bc6-b484-4666-a2ce-7d90195c2eac-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:20 devstack sudo[103051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2 1073741824 Sep 23 15:22:20 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8f5caf29-148c-430d-94d9-debee6c870f0 tempest-VolumesListTestJSON-2100941697 None] Lock "cinder-a5b82bc6-b484-4666-a2ce-7d90195c2eac-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8f5caf29-148c-430d-94d9-debee6c870f0 tempest-VolumesListTestJSON-2100941697 None] Acquiring lock "cinder-quobyte-a5b82bc6-b484-4666-a2ce-7d90195c2eac" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8f5caf29-148c-430d-94d9-debee6c870f0 tempest-VolumesListTestJSON-2100941697 None] Lock "cinder-quobyte-a5b82bc6-b484-4666-a2ce-7d90195c2eac" acquired by "delete_volume" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bb1d90-465d-4454-aa5f-601f8c8b9ff2]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f5caf29-148c-430d-94d9-debee6c870f0 tempest-VolumesListTestJSON-2100941697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5b82bc6-b484-4666-a2ce-7d90195c2eac {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:20 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5b82bc6-b484-4666-a2ce-7d90195c2eac Sep 23 15:22:20 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:21 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2 1073741824" returned: 0 in 0.465s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:21 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2 Sep 23 15:22:21 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:21 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f5caf29-148c-430d-94d9-debee6c870f0 tempest-VolumesListTestJSON-2100941697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5b82bc6-b484-4666-a2ce-7d90195c2eac" returned: 0 in 0.417s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f5caf29-148c-430d-94d9-debee6c870f0 tempest-VolumesListTestJSON-2100941697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5b82bc6-b484-4666-a2ce-7d90195c2eac {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:21 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5b82bc6-b484-4666-a2ce-7d90195c2eac Sep 23 15:22:21 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:21 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2" returned: 0 in 0.255s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50e6f2d-67a3-438e-9aba-8c177bb37d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c57318e-e802-4c6d-8af1-9602a476fea2', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eec31b0-b9b4-4e97-a997-251a37898ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:21 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Volume volume-6c57318e-e802-4c6d-8af1-9602a476fea2 (6c57318e-e802-4c6d-8af1-9602a476fea2): created successfully Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eec31b0-b9b4-4e97-a997-251a37898ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Flow 'volume_create_manager' (a5a766da-ed5b-4a75-ad62-caa4bdf1551d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:22:21 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f5caf29-148c-430d-94d9-debee6c870f0 tempest-VolumesListTestJSON-2100941697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5b82bc6-b484-4666-a2ce-7d90195c2eac" returned: 0 in 0.273s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:21 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-114b4d60-2ef2-4482-a542-43fb36303be6 tempest-VolumeDependencyTests-797075751 None] Created volume successfully. Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8f5caf29-148c-430d-94d9-debee6c870f0 tempest-VolumesListTestJSON-2100941697 None] Lock "cinder-quobyte-a5b82bc6-b484-4666-a2ce-7d90195c2eac" released by "delete_volume" :: held 0.748s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-8f5caf29-148c-430d-94d9-debee6c870f0 tempest-VolumesListTestJSON-2100941697 None] Created reservations ['d02d6df2-7d48-41b7-9404-8b706abe4cd1', '28607eca-2287-4faf-8500-c52947b694c4', '137fb025-b8ab-4fee-8f2f-418a81fc56c5', '3704d258-089f-4c62-a683-779ed5b31360'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8f5caf29-148c-430d-94d9-debee6c870f0 tempest-VolumesListTestJSON-2100941697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8f5caf29-148c-430d-94d9-debee6c870f0 tempest-VolumesListTestJSON-2100941697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8f5caf29-148c-430d-94d9-debee6c870f0 tempest-VolumesListTestJSON-2100941697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8f5caf29-148c-430d-94d9-debee6c870f0 tempest-VolumesListTestJSON-2100941697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8f5caf29-148c-430d-94d9-debee6c870f0 tempest-VolumesListTestJSON-2100941697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f5caf29-148c-430d-94d9-debee6c870f0 tempest-VolumesListTestJSON-2100941697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:21 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:22:21 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-82e2a598-e8b1-4834-9345-99925790aece tempest-VolumesListTestJSON-2100941697 None] Acquiring lock "cinder-87d89415-8851-45d6-be70-4b4c9f46d9e5-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-82e2a598-e8b1-4834-9345-99925790aece tempest-VolumesListTestJSON-2100941697 None] Lock "cinder-87d89415-8851-45d6-be70-4b4c9f46d9e5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:21 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8f5caf29-148c-430d-94d9-debee6c870f0 tempest-VolumesListTestJSON-2100941697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.343s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-8f5caf29-148c-430d-94d9-debee6c870f0 tempest-VolumesListTestJSON-2100941697 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:22:21 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-8f5caf29-148c-430d-94d9-debee6c870f0 tempest-VolumesListTestJSON-2100941697 None] Deleted volume successfully. Sep 23 15:22:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8f5caf29-148c-430d-94d9-debee6c870f0 tempest-VolumesListTestJSON-2100941697 None] Lock "cinder-a5b82bc6-b484-4666-a2ce-7d90195c2eac-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-82e2a598-e8b1-4834-9345-99925790aece tempest-VolumesListTestJSON-2100941697 None] Acquiring lock "cinder-quobyte-87d89415-8851-45d6-be70-4b4c9f46d9e5" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-82e2a598-e8b1-4834-9345-99925790aece tempest-VolumesListTestJSON-2100941697 None] Lock "cinder-quobyte-87d89415-8851-45d6-be70-4b4c9f46d9e5" acquired by "delete_volume" :: waited 0.024s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:22 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d1b842-aa52-4569-9b6d-bf894a119124]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-82e2a598-e8b1-4834-9345-99925790aece tempest-VolumesListTestJSON-2100941697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87d89415-8851-45d6-be70-4b4c9f46d9e5 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:22 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87d89415-8851-45d6-be70-4b4c9f46d9e5 Sep 23 15:22:22 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:22 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-82e2a598-e8b1-4834-9345-99925790aece tempest-VolumesListTestJSON-2100941697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87d89415-8851-45d6-be70-4b4c9f46d9e5" returned: 0 in 0.400s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-82e2a598-e8b1-4834-9345-99925790aece tempest-VolumesListTestJSON-2100941697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87d89415-8851-45d6-be70-4b4c9f46d9e5 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:22 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87d89415-8851-45d6-be70-4b4c9f46d9e5 Sep 23 15:22:22 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:22 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-82e2a598-e8b1-4834-9345-99925790aece tempest-VolumesListTestJSON-2100941697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87d89415-8851-45d6-be70-4b4c9f46d9e5" returned: 0 in 0.279s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-82e2a598-e8b1-4834-9345-99925790aece tempest-VolumesListTestJSON-2100941697 None] Lock "cinder-quobyte-87d89415-8851-45d6-be70-4b4c9f46d9e5" released by "delete_volume" :: held 0.725s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8dddc834-7aba-401e-a69b-dd162e9bc732 tempest-VolumeDependencyTests-797075751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8dddc834-7aba-401e-a69b-dd162e9bc732 tempest-VolumeDependencyTests-797075751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:22 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-82e2a598-e8b1-4834-9345-99925790aece tempest-VolumesListTestJSON-2100941697 None] Created reservations ['29a08671-153f-4d8c-abf4-5a075faddb0b', '84bf9990-23da-4e50-a478-ccebe2ab2ec1', 'd3287e02-f120-4921-ad42-0a3090aa6b3d', 'c797463f-4a46-4764-bd21-f196d2bb5948'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:22:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-8dddc834-7aba-401e-a69b-dd162e9bc732 tempest-VolumeDependencyTests-797075751 None] Creating offline snapshot b5c486e3-3fe4-46b3-a300-349a63c9285e of volume 6c57318e-e802-4c6d-8af1-9602a476fea2 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:22:22 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cce41c5-4abf-4c69-b3b5-2245db547dff]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8dddc834-7aba-401e-a69b-dd162e9bc732 tempest-VolumeDependencyTests-797075751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-82e2a598-e8b1-4834-9345-99925790aece tempest-VolumesListTestJSON-2100941697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-82e2a598-e8b1-4834-9345-99925790aece tempest-VolumesListTestJSON-2100941697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-82e2a598-e8b1-4834-9345-99925790aece tempest-VolumesListTestJSON-2100941697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-82e2a598-e8b1-4834-9345-99925790aece tempest-VolumesListTestJSON-2100941697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-82e2a598-e8b1-4834-9345-99925790aece tempest-VolumesListTestJSON-2100941697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-82e2a598-e8b1-4834-9345-99925790aece tempest-VolumesListTestJSON-2100941697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:22 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:22:22 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:22 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2 Sep 23 15:22:22 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cbca66b5-1864-4a6d-bbdc-1edcc33b0190 tempest-VolumesListTestJSON-2100941697 None] Acquiring lock "cinder-5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cbca66b5-1864-4a6d-bbdc-1edcc33b0190 tempest-VolumesListTestJSON-2100941697 None] Lock "cinder-5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:23 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cbca66b5-1864-4a6d-bbdc-1edcc33b0190 tempest-VolumesListTestJSON-2100941697 None] Acquiring lock "cinder-quobyte-5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-82e2a598-e8b1-4834-9345-99925790aece tempest-VolumesListTestJSON-2100941697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.318s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:23 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-82e2a598-e8b1-4834-9345-99925790aece tempest-VolumesListTestJSON-2100941697 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:22:23 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-82e2a598-e8b1-4834-9345-99925790aece tempest-VolumesListTestJSON-2100941697 None] Deleted volume successfully. Sep 23 15:22:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cbca66b5-1864-4a6d-bbdc-1edcc33b0190 tempest-VolumesListTestJSON-2100941697 None] Lock "cinder-quobyte-5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67" acquired by "delete_volume" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-82e2a598-e8b1-4834-9345-99925790aece tempest-VolumesListTestJSON-2100941697 None] Lock "cinder-87d89415-8851-45d6-be70-4b4c9f46d9e5-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:23 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b9ba39-f9eb-41f4-95c6-e927c3d00d9a]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:23 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cbca66b5-1864-4a6d-bbdc-1edcc33b0190 tempest-VolumesListTestJSON-2100941697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8dddc834-7aba-401e-a69b-dd162e9bc732 tempest-VolumeDependencyTests-797075751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2" returned: 0 in 0.477s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8dddc834-7aba-401e-a69b-dd162e9bc732 tempest-VolumeDependencyTests-797075751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:23 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e 1G Sep 23 15:22:23 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:23 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67 Sep 23 15:22:23 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:23 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cbca66b5-1864-4a6d-bbdc-1edcc33b0190 tempest-VolumesListTestJSON-2100941697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67" returned: 0 in 0.403s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cbca66b5-1864-4a6d-bbdc-1edcc33b0190 tempest-VolumesListTestJSON-2100941697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:23 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67 Sep 23 15:22:23 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:23 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8dddc834-7aba-401e-a69b-dd162e9bc732 tempest-VolumeDependencyTests-797075751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e 1G" returned: 0 in 0.444s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8dddc834-7aba-401e-a69b-dd162e9bc732 tempest-VolumeDependencyTests-797075751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c57318e-e802-4c6d-8af1-9602a476fea2 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:23 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c57318e-e802-4c6d-8af1-9602a476fea2 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e Sep 23 15:22:23 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:23 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cbca66b5-1864-4a6d-bbdc-1edcc33b0190 tempest-VolumesListTestJSON-2100941697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67" returned: 0 in 0.255s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cbca66b5-1864-4a6d-bbdc-1edcc33b0190 tempest-VolumesListTestJSON-2100941697 None] Lock "cinder-quobyte-5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67" released by "delete_volume" :: held 0.721s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:24 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-cbca66b5-1864-4a6d-bbdc-1edcc33b0190 tempest-VolumesListTestJSON-2100941697 None] Created reservations ['d4278a6b-d987-448b-9373-55fde732e4dc', '45e1844a-3ef4-42e9-812a-1832a7cb3424', '705d2ed3-87f2-448c-8fe1-d9b1698d63ef', '61c134ca-0f77-4c8e-acb7-b3b1ac4f114e'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:22:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cbca66b5-1864-4a6d-bbdc-1edcc33b0190 tempest-VolumesListTestJSON-2100941697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cbca66b5-1864-4a6d-bbdc-1edcc33b0190 tempest-VolumesListTestJSON-2100941697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:24 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cbca66b5-1864-4a6d-bbdc-1edcc33b0190 tempest-VolumesListTestJSON-2100941697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cbca66b5-1864-4a6d-bbdc-1edcc33b0190 tempest-VolumesListTestJSON-2100941697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cbca66b5-1864-4a6d-bbdc-1edcc33b0190 tempest-VolumesListTestJSON-2100941697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cbca66b5-1864-4a6d-bbdc-1edcc33b0190 tempest-VolumesListTestJSON-2100941697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8dddc834-7aba-401e-a69b-dd162e9bc732 tempest-VolumeDependencyTests-797075751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c57318e-e802-4c6d-8af1-9602a476fea2 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e" returned: 0 in 0.350s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:24 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-8dddc834-7aba-401e-a69b-dd162e9bc732 tempest-VolumeDependencyTests-797075751 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e is being set with open permissions: ugo+rw Sep 23 15:22:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8dddc834-7aba-401e-a69b-dd162e9bc732 tempest-VolumeDependencyTests-797075751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:24 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:22:24 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:24 devstack sudo[103158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e Sep 23 15:22:24 devstack sudo[103158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:24 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cbca66b5-1864-4a6d-bbdc-1edcc33b0190 tempest-VolumesListTestJSON-2100941697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.277s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:24 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-cbca66b5-1864-4a6d-bbdc-1edcc33b0190 tempest-VolumesListTestJSON-2100941697 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:22:24 devstack sudo[103158]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:24 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-cbca66b5-1864-4a6d-bbdc-1edcc33b0190 tempest-VolumesListTestJSON-2100941697 None] Deleted volume successfully. Sep 23 15:22:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8dddc834-7aba-401e-a69b-dd162e9bc732 tempest-VolumeDependencyTests-797075751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e" returned: 0 in 0.281s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cbca66b5-1864-4a6d-bbdc-1edcc33b0190 tempest-VolumesListTestJSON-2100941697 None] Lock "cinder-5e504fe3-0ceb-48f2-ac82-fbbf5d35fd67-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8dddc834-7aba-401e-a69b-dd162e9bc732 tempest-VolumeDependencyTests-797075751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:24 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.info Sep 23 15:22:24 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:24 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8dddc834-7aba-401e-a69b-dd162e9bc732 tempest-VolumeDependencyTests-797075751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.info" returned: 0 in 0.279s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:24 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-8dddc834-7aba-401e-a69b-dd162e9bc732 tempest-VolumeDependencyTests-797075751 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.info is being set with open permissions: ugo+rw Sep 23 15:22:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8dddc834-7aba-401e-a69b-dd162e9bc732 tempest-VolumeDependencyTests-797075751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:24 devstack sudo[103172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.info Sep 23 15:22:24 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:25 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8dddc834-7aba-401e-a69b-dd162e9bc732 tempest-VolumeDependencyTests-797075751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.info" returned: 0 in 0.271s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8dddc834-7aba-401e-a69b-dd162e9bc732 tempest-VolumeDependencyTests-797075751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.224s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:25 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-8dddc834-7aba-401e-a69b-dd162e9bc732 tempest-VolumeDependencyTests-797075751 None] Create snapshot completed successfully Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Flow 'volume_create_manager' (67dad114-8c4b-4860-869c-7eb41ede8f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2089279d-6d96-4011-a979-4dd67e69d039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2089279d-6d96-4011-a979-4dd67e69d039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-301466098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843d05739c8e42f49fe3bafd68cbb7fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b5c486e3-3fe4-46b3-a300-349a63c9285e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:22:26Z,use_quota=True,user_id='a66886720fe14ca587fb30df90a43949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd03976-8b8e-4e25-a3a5-8a51e84ed4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd03976-8b8e-4e25-a3a5-8a51e84ed4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb4023b-185f-482d-9d39-c7ddf10159be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb4023b-185f-482d-9d39-c7ddf10159be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4', 'volume_name': 'volume-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4', 'volume_size': 1, 'snapshot_id': 'b5c486e3-3fe4-46b3-a300-349a63c9285e'}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54d985c-10cb-4520-afef-c3fb2eb11445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54d985c-10cb-4520-afef-c3fb2eb11445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16108b66-3ecb-4147-bff7-41b625c16552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:26 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Volume 21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4', 'volume_size': 1, 'snapshot_id': 'b5c486e3-3fe4-46b3-a300-349a63c9285e'} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Acquiring lock "cinder-quobyte-b5c486e3-3fe4-46b3-a300-349a63c9285e-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4" by "_create_volume_from_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Lock "cinder-quobyte-b5c486e3-3fe4-46b3-a300-349a63c9285e-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Creating volume 21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4 from snapshot b5c486e3-3fe4-46b3-a300-349a63c9285e {{(pid=86064) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Acquiring lock "cinder-quobyte-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4" by "_copy_volume_from_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Lock "cinder-quobyte-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] snapshot: b5c486e3-3fe4-46b3-a300-349a63c9285e, volume: 21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4, {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8d8602-e2a8-445d-8bfd-a4b44b0297dd]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:26 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e Sep 23 15:22:26 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:27 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e" returned: 0 in 0.401s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:27 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c57318e-e802-4c6d-8af1-9602a476fea2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:22:27 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4ac431-a570-4398-9952-d69cefe6990b]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:27 devstack sudo[103181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2 Sep 23 15:22:27 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:27 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2" returned: 0 in 0.390s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:27 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2 {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 15:22:27 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Creating direct copy from snapshot {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 15:22:27 devstack cinder-volume[86064]: DEBUG cinder.utils [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Path /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4 not found in is_blk_device check {{(pid=86064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 15:22:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:27 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4 Sep 23 15:22:27 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:28 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=104,cinder:UPDATE=122,cinder:INSERT=27,cinder:DELETE=8 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:22:28 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:22:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Flow 'volume_create_manager' (10779ba4-8154-4302-a472-d908562cb968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:22:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baed07b7-fabd-4267-af6e-0ec209825a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baed07b7-fabd-4267-af6e-0ec209825a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1156562641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9747b20b-865b-49e3-9081-a0736a3c366e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c39628a69a544cd9adfdcf8c36c1e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:22:28Z,use_quota=True,user_id='dc67fbc37f5f4706a52ecd6ac6ba757e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918e4fff-35d0-44fe-baf5-d059498da042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918e4fff-35d0-44fe-baf5-d059498da042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52bb44a7-8dfb-4b5e-8120-c2b0da4300b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52bb44a7-8dfb-4b5e-8120-c2b0da4300b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9747b20b-865b-49e3-9081-a0736a3c366e', 'volume_name': 'volume-9747b20b-865b-49e3-9081-a0736a3c366e', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee89496-6acb-4ad3-8906-e0828efe8696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee89496-6acb-4ad3-8906-e0828efe8696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3431a327-d9b2-4867-a0b4-1f659ac71d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:28 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Volume 9747b20b-865b-49e3-9081-a0736a3c366e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9747b20b-865b-49e3-9081-a0736a3c366e', 'volume_size': 1} Sep 23 15:22:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:34 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4" returned: 0 in 6.635s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:34 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4 {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:22:34 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Converted 1024.00 MB image at 154.30 MB/s Sep 23 15:22:34 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4 is being set with open permissions: ugo+rw Sep 23 15:22:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:34 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4 Sep 23 15:22:34 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:34 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4" returned: 0 in 0.240s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:34 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Lock "cinder-quobyte-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4" released by "_copy_volume_from_snapshot" :: held 7.755s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:34 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Lock "cinder-quobyte-b5c486e3-3fe4-46b3-a300-349a63c9285e-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4" released by "_create_volume_from_snapshot" :: held 7.819s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.834s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.177s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1156562641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9747b20b-865b-49e3-9081-a0736a3c366e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c39628a69a544cd9adfdcf8c36c1e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:22:28Z,use_quota=True,user_id='dc67fbc37f5f4706a52ecd6ac6ba757e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:22:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Creating volume 9747b20b-865b-49e3-9081-a0736a3c366e {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:22:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:22:34 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:22:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9747b20b-865b-49e3-9081-a0736a3c366e 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:34 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9747b20b-865b-49e3-9081-a0736a3c366e 1073741824 Sep 23 15:22:34 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16108b66-3ecb-4147-bff7-41b625c16552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4', 'volume_size': 1, 'snapshot_id': 'b5c486e3-3fe4-46b3-a300-349a63c9285e'}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07479b66-5c82-4da8-ba21-38c4be01e44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:34 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Volume volume-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4 (21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4): created successfully Sep 23 15:22:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07479b66-5c82-4da8-ba21-38c4be01e44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Flow 'volume_create_manager' (67dad114-8c4b-4860-869c-7eb41ede8f29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:22:34 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-bcace4a3-d6f9-4e3b-86b6-564f3bb4bdfe tempest-VolumeDependencyTests-797075751 None] Created volume successfully. Sep 23 15:22:34 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9747b20b-865b-49e3-9081-a0736a3c366e 1073741824" returned: 0 in 0.460s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9747b20b-865b-49e3-9081-a0736a3c366e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:35 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9747b20b-865b-49e3-9081-a0736a3c366e Sep 23 15:22:35 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:35 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9747b20b-865b-49e3-9081-a0736a3c366e" returned: 0 in 0.265s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3431a327-d9b2-4867-a0b4-1f659ac71d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9747b20b-865b-49e3-9081-a0736a3c366e', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3349f5fc-63a5-450c-9684-40a9d129cf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a74bedc4-3d30-460b-8ea7-e8700b89babc tempest-VolumeDependencyTests-797075751 None] Acquiring lock "cinder-b5c486e3-3fe4-46b3-a300-349a63c9285e-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:35 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Volume volume-9747b20b-865b-49e3-9081-a0736a3c366e (9747b20b-865b-49e3-9081-a0736a3c366e): created successfully Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3349f5fc-63a5-450c-9684-40a9d129cf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Flow 'volume_create_manager' (10779ba4-8154-4302-a472-d908562cb968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a74bedc4-3d30-460b-8ea7-e8700b89babc tempest-VolumeDependencyTests-797075751 None] Lock "cinder-b5c486e3-3fe4-46b3-a300-349a63c9285e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a74bedc4-3d30-460b-8ea7-e8700b89babc tempest-VolumeDependencyTests-797075751 None] Acquiring lock "cinder-quobyte-6c57318e-e802-4c6d-8af1-9602a476fea2" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:35 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f7ad6cb9-3685-40aa-bfc5-645d98514abf tempest-VolumesNegativeTest-613788903 None] Created volume successfully. Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a74bedc4-3d30-460b-8ea7-e8700b89babc tempest-VolumeDependencyTests-797075751 None] Lock "cinder-quobyte-6c57318e-e802-4c6d-8af1-9602a476fea2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a74bedc4-3d30-460b-8ea7-e8700b89babc tempest-VolumeDependencyTests-797075751 None] Acquiring lock "cinder-quobyte-b5c486e3-3fe4-46b3-a300-349a63c9285e" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a74bedc4-3d30-460b-8ea7-e8700b89babc tempest-VolumeDependencyTests-797075751 None] Lock "cinder-quobyte-b5c486e3-3fe4-46b3-a300-349a63c9285e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-a74bedc4-3d30-460b-8ea7-e8700b89babc tempest-VolumeDependencyTests-797075751 None] Deleting offline snapshot b5c486e3-3fe4-46b3-a300-349a63c9285e of volume 6c57318e-e802-4c6d-8af1-9602a476fea2 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-a74bedc4-3d30-460b-8ea7-e8700b89babc tempest-VolumeDependencyTests-797075751 None] snapshot_file for this snap is: volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[61be698c-6cb9-4327-88ba-6499f9aec033]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a74bedc4-3d30-460b-8ea7-e8700b89babc tempest-VolumeDependencyTests-797075751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:35 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e Sep 23 15:22:35 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:35 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a74bedc4-3d30-460b-8ea7-e8700b89babc tempest-VolumeDependencyTests-797075751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e" returned: 0 in 0.403s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-a74bedc4-3d30-460b-8ea7-e8700b89babc tempest-VolumeDependencyTests-797075751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c57318e-e802-4c6d-8af1-9602a476fea2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcae1af-8a75-4eb1-a94f-41693b1fc8eb]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a74bedc4-3d30-460b-8ea7-e8700b89babc tempest-VolumeDependencyTests-797075751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-eecb3ee4-859e-43b7-817e-eccdfb21376d req-a0732ab6-f6bd-4f47-af14-137777ea6af0 tempest-TestStampPattern-757802660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-eecb3ee4-859e-43b7-817e-eccdfb21376d req-a0732ab6-f6bd-4f47-af14-137777ea6af0 tempest-TestStampPattern-757802660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-eecb3ee4-859e-43b7-817e-eccdfb21376d req-a0732ab6-f6bd-4f47-af14-137777ea6af0 tempest-TestStampPattern-757802660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-eecb3ee4-859e-43b7-817e-eccdfb21376d req-a0732ab6-f6bd-4f47-af14-137777ea6af0 tempest-TestStampPattern-757802660 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-cd277d65-db4d-4239-a41a-074a51dea68f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '361419f2-837d-4794-8dab-2b222586b6e0', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:22:36 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2 Sep 23 15:22:36 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:36 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-eecb3ee4-859e-43b7-817e-eccdfb21376d req-a0732ab6-f6bd-4f47-af14-137777ea6af0 tempest-TestStampPattern-757802660 None] attachment_update completed successfully. Sep 23 15:22:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:22:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:36 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:22:36 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:36 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.402s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:22:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:22:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 28 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:22:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:22:36 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a74bedc4-3d30-460b-8ea7-e8700b89babc tempest-VolumeDependencyTests-797075751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2" returned: 0 in 0.692s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a74bedc4-3d30-460b-8ea7-e8700b89babc tempest-VolumeDependencyTests-797075751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:36 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e Sep 23 15:22:36 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:37 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a74bedc4-3d30-460b-8ea7-e8700b89babc tempest-VolumeDependencyTests-797075751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e" returned: 0 in 0.439s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a74bedc4-3d30-460b-8ea7-e8700b89babc tempest-VolumeDependencyTests-797075751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:37 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e Sep 23 15:22:37 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:37 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a74bedc4-3d30-460b-8ea7-e8700b89babc tempest-VolumeDependencyTests-797075751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2.b5c486e3-3fe4-46b3-a300-349a63c9285e" returned: 0 in 0.274s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a74bedc4-3d30-460b-8ea7-e8700b89babc tempest-VolumeDependencyTests-797075751 None] Lock "cinder-quobyte-b5c486e3-3fe4-46b3-a300-349a63c9285e" released by "_delete_snapshot" :: held 1.960s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a74bedc4-3d30-460b-8ea7-e8700b89babc tempest-VolumeDependencyTests-797075751 None] Lock "cinder-quobyte-6c57318e-e802-4c6d-8af1-9602a476fea2" released by "delete_snapshot" :: held 1.992s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:37 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-a74bedc4-3d30-460b-8ea7-e8700b89babc tempest-VolumeDependencyTests-797075751 None] Created reservations ['f9877402-85cc-4981-a78c-901d8557e205', 'f8402e0f-1322-4afa-b236-734f78dbc2d7', '4bd035a3-57d1-4b32-b32d-3ebdddd711fa', '6b0d8f29-5f15-4944-8884-a007cbe85472'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:22:37 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-a74bedc4-3d30-460b-8ea7-e8700b89babc tempest-VolumeDependencyTests-797075751 None] Delete snapshot completed successfully. Sep 23 15:22:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a74bedc4-3d30-460b-8ea7-e8700b89babc tempest-VolumeDependencyTests-797075751 None] Lock "cinder-b5c486e3-3fe4-46b3-a300-349a63c9285e-delete_snapshot" released by "delete_snapshot" :: held 2.154s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-43eba049-5aaf-4323-a80d-5b073ca981c6 tempest-VolumeDependencyTests-797075751 None] Acquiring lock "cinder-6c57318e-e802-4c6d-8af1-9602a476fea2-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-43eba049-5aaf-4323-a80d-5b073ca981c6 tempest-VolumeDependencyTests-797075751 None] Lock "cinder-6c57318e-e802-4c6d-8af1-9602a476fea2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-43eba049-5aaf-4323-a80d-5b073ca981c6 tempest-VolumeDependencyTests-797075751 None] Acquiring lock "cinder-quobyte-6c57318e-e802-4c6d-8af1-9602a476fea2" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-43eba049-5aaf-4323-a80d-5b073ca981c6 tempest-VolumeDependencyTests-797075751 None] Lock "cinder-quobyte-6c57318e-e802-4c6d-8af1-9602a476fea2" acquired by "delete_volume" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:38 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25b277a-870a-446c-9f37-c7747a03fd69]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43eba049-5aaf-4323-a80d-5b073ca981c6 tempest-VolumeDependencyTests-797075751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:38 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2 Sep 23 15:22:38 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:39 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43eba049-5aaf-4323-a80d-5b073ca981c6 tempest-VolumeDependencyTests-797075751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2" returned: 0 in 0.502s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43eba049-5aaf-4323-a80d-5b073ca981c6 tempest-VolumeDependencyTests-797075751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:39 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2 Sep 23 15:22:39 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:39 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-3ad70faf-7085-4c07-bf79-4b0c98182b51 req-7bf0ceb7-ff3b-4358-b50c-def029d4d891 tempest-TestStampPattern-757802660 None] Terminate volume connection completed successfully. Sep 23 15:22:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-3ad70faf-7085-4c07-bf79-4b0c98182b51 req-7bf0ceb7-ff3b-4358-b50c-def029d4d891 tempest-TestStampPattern-757802660 None] Deleting attachment 361419f2-837d-4794-8dab-2b222586b6e0. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:22:39 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43eba049-5aaf-4323-a80d-5b073ca981c6 tempest-VolumeDependencyTests-797075751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6c57318e-e802-4c6d-8af1-9602a476fea2" returned: 0 in 0.308s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-43eba049-5aaf-4323-a80d-5b073ca981c6 tempest-VolumeDependencyTests-797075751 None] Lock "cinder-quobyte-6c57318e-e802-4c6d-8af1-9602a476fea2" released by "delete_volume" :: held 0.939s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:39 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-43eba049-5aaf-4323-a80d-5b073ca981c6 tempest-VolumeDependencyTests-797075751 None] Created reservations ['f9aae4cf-5af4-42c2-82cf-ba58f64eb7ac', '7fb49359-9cc7-498a-a724-47f2b53d85cf', '8720668d-410f-4866-85d9-8254448d4405', '5790065c-82a0-411f-a83a-e71cfb0fd15d'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:22:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-43eba049-5aaf-4323-a80d-5b073ca981c6 tempest-VolumeDependencyTests-797075751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-43eba049-5aaf-4323-a80d-5b073ca981c6 tempest-VolumeDependencyTests-797075751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-43eba049-5aaf-4323-a80d-5b073ca981c6 tempest-VolumeDependencyTests-797075751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-43eba049-5aaf-4323-a80d-5b073ca981c6 tempest-VolumeDependencyTests-797075751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-43eba049-5aaf-4323-a80d-5b073ca981c6 tempest-VolumeDependencyTests-797075751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43eba049-5aaf-4323-a80d-5b073ca981c6 tempest-VolumeDependencyTests-797075751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:39 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:22:39 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:40 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-43eba049-5aaf-4323-a80d-5b073ca981c6 tempest-VolumeDependencyTests-797075751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.303s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:40 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-43eba049-5aaf-4323-a80d-5b073ca981c6 tempest-VolumeDependencyTests-797075751 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:22:40 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-43eba049-5aaf-4323-a80d-5b073ca981c6 tempest-VolumeDependencyTests-797075751 None] Deleted volume successfully. Sep 23 15:22:40 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-43eba049-5aaf-4323-a80d-5b073ca981c6 tempest-VolumeDependencyTests-797075751 None] Lock "cinder-6c57318e-e802-4c6d-8af1-9602a476fea2-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:40 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-66de2dde-7174-4336-b495-c0e2d5985a01 tempest-VolumeDependencyTests-797075751 None] Acquiring lock "cinder-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-66de2dde-7174-4336-b495-c0e2d5985a01 tempest-VolumeDependencyTests-797075751 None] Lock "cinder-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-66de2dde-7174-4336-b495-c0e2d5985a01 tempest-VolumeDependencyTests-797075751 None] Acquiring lock "cinder-quobyte-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-66de2dde-7174-4336-b495-c0e2d5985a01 tempest-VolumeDependencyTests-797075751 None] Lock "cinder-quobyte-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4" acquired by "delete_volume" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:41 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b413f924-b4e6-46a1-a116-c040c53941d1]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-66de2dde-7174-4336-b495-c0e2d5985a01 tempest-VolumeDependencyTests-797075751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:41 devstack sudo[103739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4 Sep 23 15:22:41 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:41 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-66de2dde-7174-4336-b495-c0e2d5985a01 tempest-VolumeDependencyTests-797075751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4" returned: 0 in 0.597s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-66de2dde-7174-4336-b495-c0e2d5985a01 tempest-VolumeDependencyTests-797075751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:41 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4 Sep 23 15:22:41 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:42 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-66de2dde-7174-4336-b495-c0e2d5985a01 tempest-VolumeDependencyTests-797075751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4" returned: 0 in 0.414s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:42 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-66de2dde-7174-4336-b495-c0e2d5985a01 tempest-VolumeDependencyTests-797075751 None] Lock "cinder-quobyte-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4" released by "delete_volume" :: held 1.096s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:42 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-66de2dde-7174-4336-b495-c0e2d5985a01 tempest-VolumeDependencyTests-797075751 None] Created reservations ['ca3db44c-3d4d-4e20-96c1-b8b4fd720f65', 'ce5111dc-60f2-49cc-b9a3-4643ea33e5f6', 'cb7ce4e8-2a44-41a5-a193-706b7e67a71c', 'a4240f24-e0ed-4a5b-b586-e3e25f964e63'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:22:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-66de2dde-7174-4336-b495-c0e2d5985a01 tempest-VolumeDependencyTests-797075751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-66de2dde-7174-4336-b495-c0e2d5985a01 tempest-VolumeDependencyTests-797075751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:42 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-66de2dde-7174-4336-b495-c0e2d5985a01 tempest-VolumeDependencyTests-797075751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:42 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-66de2dde-7174-4336-b495-c0e2d5985a01 tempest-VolumeDependencyTests-797075751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-66de2dde-7174-4336-b495-c0e2d5985a01 tempest-VolumeDependencyTests-797075751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-66de2dde-7174-4336-b495-c0e2d5985a01 tempest-VolumeDependencyTests-797075751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:42 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:22:42 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:42 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-66de2dde-7174-4336-b495-c0e2d5985a01 tempest-VolumeDependencyTests-797075751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.280s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:42 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-66de2dde-7174-4336-b495-c0e2d5985a01 tempest-VolumeDependencyTests-797075751 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:22:42 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-66de2dde-7174-4336-b495-c0e2d5985a01 tempest-VolumeDependencyTests-797075751 None] Deleted volume successfully. Sep 23 15:22:42 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-66de2dde-7174-4336-b495-c0e2d5985a01 tempest-VolumeDependencyTests-797075751 None] Lock "cinder-21f7139a-4f8b-4adb-ac6e-9b13a2c0c1c4-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e5c64c6c-dc5c-4d9f-aff6-fd8a79ad3296 tempest-TestStampPattern-757802660 None] Acquiring lock "cinder-cd277d65-db4d-4239-a41a-074a51dea68f-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e5c64c6c-dc5c-4d9f-aff6-fd8a79ad3296 tempest-TestStampPattern-757802660 None] Lock "cinder-cd277d65-db4d-4239-a41a-074a51dea68f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e5c64c6c-dc5c-4d9f-aff6-fd8a79ad3296 tempest-TestStampPattern-757802660 None] Acquiring lock "cinder-quobyte-cd277d65-db4d-4239-a41a-074a51dea68f" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e5c64c6c-dc5c-4d9f-aff6-fd8a79ad3296 tempest-TestStampPattern-757802660 None] Lock "cinder-quobyte-cd277d65-db4d-4239-a41a-074a51dea68f" acquired by "delete_volume" :: waited 0.016s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:45 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[135bb0a5-f530-4568-b3ba-441a3dd9b603]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e5c64c6c-dc5c-4d9f-aff6-fd8a79ad3296 tempest-TestStampPattern-757802660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd277d65-db4d-4239-a41a-074a51dea68f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:45 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd277d65-db4d-4239-a41a-074a51dea68f Sep 23 15:22:45 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:45 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e5c64c6c-dc5c-4d9f-aff6-fd8a79ad3296 tempest-TestStampPattern-757802660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd277d65-db4d-4239-a41a-074a51dea68f" returned: 0 in 0.444s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e5c64c6c-dc5c-4d9f-aff6-fd8a79ad3296 tempest-TestStampPattern-757802660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd277d65-db4d-4239-a41a-074a51dea68f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:45 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd277d65-db4d-4239-a41a-074a51dea68f Sep 23 15:22:45 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:45 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e5c64c6c-dc5c-4d9f-aff6-fd8a79ad3296 tempest-TestStampPattern-757802660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cd277d65-db4d-4239-a41a-074a51dea68f" returned: 0 in 0.301s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e5c64c6c-dc5c-4d9f-aff6-fd8a79ad3296 tempest-TestStampPattern-757802660 None] Lock "cinder-quobyte-cd277d65-db4d-4239-a41a-074a51dea68f" released by "delete_volume" :: held 0.822s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:46 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-e5c64c6c-dc5c-4d9f-aff6-fd8a79ad3296 tempest-TestStampPattern-757802660 None] Created reservations ['6e30f75c-5e91-4da0-adc7-71e770e4ad97', '6e9e6d2f-e46b-4958-a436-f9dfa1bd0f52', '48fd3402-01d6-4df0-b7bd-452ef57f9aa4', 'a57e76da-e726-452e-bb1f-0ec36d19e10d'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:22:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e5c64c6c-dc5c-4d9f-aff6-fd8a79ad3296 tempest-TestStampPattern-757802660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e5c64c6c-dc5c-4d9f-aff6-fd8a79ad3296 tempest-TestStampPattern-757802660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e5c64c6c-dc5c-4d9f-aff6-fd8a79ad3296 tempest-TestStampPattern-757802660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e5c64c6c-dc5c-4d9f-aff6-fd8a79ad3296 tempest-TestStampPattern-757802660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e5c64c6c-dc5c-4d9f-aff6-fd8a79ad3296 tempest-TestStampPattern-757802660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e5c64c6c-dc5c-4d9f-aff6-fd8a79ad3296 tempest-TestStampPattern-757802660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:46 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:22:46 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:46 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e5c64c6c-dc5c-4d9f-aff6-fd8a79ad3296 tempest-TestStampPattern-757802660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.469s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:46 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-e5c64c6c-dc5c-4d9f-aff6-fd8a79ad3296 tempest-TestStampPattern-757802660 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:22:46 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-e5c64c6c-dc5c-4d9f-aff6-fd8a79ad3296 tempest-TestStampPattern-757802660 None] Deleted volume successfully. Sep 23 15:22:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e5c64c6c-dc5c-4d9f-aff6-fd8a79ad3296 tempest-TestStampPattern-757802660 None] Lock "cinder-cd277d65-db4d-4239-a41a-074a51dea68f-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-23bd7b50-56f0-4b84-ae20-7f984431f77b tempest-TestStampPattern-757802660 None] Acquiring lock "cinder-c3346f20-a8d5-4aec-b7c4-2c772ded9a81-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-23bd7b50-56f0-4b84-ae20-7f984431f77b tempest-TestStampPattern-757802660 None] Lock "cinder-c3346f20-a8d5-4aec-b7c4-2c772ded9a81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-23bd7b50-56f0-4b84-ae20-7f984431f77b tempest-TestStampPattern-757802660 None] Acquiring lock "cinder-quobyte-87b68c37-42e3-4232-8775-c79538c4075e" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-23bd7b50-56f0-4b84-ae20-7f984431f77b tempest-TestStampPattern-757802660 None] Lock "cinder-quobyte-87b68c37-42e3-4232-8775-c79538c4075e" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-23bd7b50-56f0-4b84-ae20-7f984431f77b tempest-TestStampPattern-757802660 None] Acquiring lock "cinder-quobyte-c3346f20-a8d5-4aec-b7c4-2c772ded9a81" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-23bd7b50-56f0-4b84-ae20-7f984431f77b tempest-TestStampPattern-757802660 None] Lock "cinder-quobyte-c3346f20-a8d5-4aec-b7c4-2c772ded9a81" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-23bd7b50-56f0-4b84-ae20-7f984431f77b tempest-TestStampPattern-757802660 None] Deleting offline snapshot c3346f20-a8d5-4aec-b7c4-2c772ded9a81 of volume 87b68c37-42e3-4232-8775-c79538c4075e {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:22:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-23bd7b50-56f0-4b84-ae20-7f984431f77b tempest-TestStampPattern-757802660 None] snapshot_file for this snap is: volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:22:46 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a017a26e-af3e-4790-a2e1-325fe23bbade]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-23bd7b50-56f0-4b84-ae20-7f984431f77b tempest-TestStampPattern-757802660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:47 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81 Sep 23 15:22:47 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:47 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-23bd7b50-56f0-4b84-ae20-7f984431f77b tempest-TestStampPattern-757802660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81" returned: 0 in 0.439s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:47 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-23bd7b50-56f0-4b84-ae20-7f984431f77b tempest-TestStampPattern-757802660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87b68c37-42e3-4232-8775-c79538c4075e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:22:47 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5367eb-979d-4ef5-b392-fdb4c287248e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-23bd7b50-56f0-4b84-ae20-7f984431f77b tempest-TestStampPattern-757802660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:47 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e Sep 23 15:22:47 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:48 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-23bd7b50-56f0-4b84-ae20-7f984431f77b tempest-TestStampPattern-757802660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e" returned: 0 in 0.734s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-23bd7b50-56f0-4b84-ae20-7f984431f77b tempest-TestStampPattern-757802660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:48 devstack sudo[103863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81 Sep 23 15:22:48 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:48 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-23bd7b50-56f0-4b84-ae20-7f984431f77b tempest-TestStampPattern-757802660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81" returned: 0 in 0.585s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-23bd7b50-56f0-4b84-ae20-7f984431f77b tempest-TestStampPattern-757802660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:48 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81 Sep 23 15:22:48 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:49 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-23bd7b50-56f0-4b84-ae20-7f984431f77b tempest-TestStampPattern-757802660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e.c3346f20-a8d5-4aec-b7c4-2c772ded9a81" returned: 0 in 0.296s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-23bd7b50-56f0-4b84-ae20-7f984431f77b tempest-TestStampPattern-757802660 None] Lock "cinder-quobyte-c3346f20-a8d5-4aec-b7c4-2c772ded9a81" released by "_delete_snapshot" :: held 2.213s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-23bd7b50-56f0-4b84-ae20-7f984431f77b tempest-TestStampPattern-757802660 None] Lock "cinder-quobyte-87b68c37-42e3-4232-8775-c79538c4075e" released by "delete_snapshot" :: held 2.246s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:49 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-23bd7b50-56f0-4b84-ae20-7f984431f77b tempest-TestStampPattern-757802660 None] Created reservations ['c5e57286-eb4a-4407-b42e-c873b680d80e', '2b1af2b0-4429-4362-962a-4d673e184eca', '392559d4-1ed0-4e8e-88a0-ff35f22ada32', 'ffa9b5d4-547a-485f-bb97-959436ec6f57'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:22:49 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-23bd7b50-56f0-4b84-ae20-7f984431f77b tempest-TestStampPattern-757802660 None] Delete snapshot completed successfully. Sep 23 15:22:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-23bd7b50-56f0-4b84-ae20-7f984431f77b tempest-TestStampPattern-757802660 None] Lock "cinder-c3346f20-a8d5-4aec-b7c4-2c772ded9a81-delete_snapshot" released by "delete_snapshot" :: held 2.443s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:50 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:22:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Flow 'volume_create_manager' (83b184d6-b1a0-4fb4-a989-535d9683cec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:22:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2e5c0e-bed3-4147-9d09-a89f5e53a438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2e5c0e-bed3-4147-9d09-a89f5e53a438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bad29b6-41a1-497c-9620-f485af7f5ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0608b1e62b48358fa1f46cc7068382',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:22:51Z,use_quota=True,user_id='23e271e143164a93bca0875bce42568b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (790a3d7f-f5c3-48ba-b59d-c908a74a7eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (790a3d7f-f5c3-48ba-b59d-c908a74a7eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59da720d-a209-47a9-b7d3-f3110784cfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:50 devstack cinder-volume[86064]: DEBUG cinder.image.glance [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Creating Keystone auth plugin from conf {{(pid=86064) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 15:22:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59da720d-a209-47a9-b7d3-f3110784cfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1bad29b6-41a1-497c-9620-f485af7f5ade', 'volume_name': 'volume-1bad29b6-41a1-497c-9620-f485af7f5ade', 'volume_size': 1, 'image_id': '811c9286-f779-4143-8458-e9251f3c8756', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/811c9286-f779-4143-8458-e9251f3c8756', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9ad441afa1f4275a5992aadf5e568237', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f0608b1e62b48358fa1f46cc7068382', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dbc98dcb42b848396e0b26dea4e693b86b30bda730b30d11ef8561ed337b2ddef8f046ea1dafdf2a60ad8b11914b57203e64c011e391a10fe3ab50ee88afb19e', 'id': '811c9286-f779-4143-8458-e9251f3c8756', 'created_at': datetime.datetime(2026, 9, 23, 13, 22, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 22, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/811c9286-f779-4143-8458-e9251f3c8756/file', 'properties': {}}, 'image_service': }' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288cfd1f-f124-4afa-8478-f340a7aa1133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288cfd1f-f124-4afa-8478-f340a7aa1133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79fb441f-a3b2-4606-b4e5-0712db56a30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:51 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Volume 1bad29b6-41a1-497c-9620-f485af7f5ade: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1bad29b6-41a1-497c-9620-f485af7f5ade', 'volume_size': 1, 'image_id': '811c9286-f779-4143-8458-e9251f3c8756', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/811c9286-f779-4143-8458-e9251f3c8756', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9ad441afa1f4275a5992aadf5e568237', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f0608b1e62b48358fa1f46cc7068382', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dbc98dcb42b848396e0b26dea4e693b86b30bda730b30d11ef8561ed337b2ddef8f046ea1dafdf2a60ad8b11914b57203e64c011e391a10fe3ab50ee88afb19e', 'id': '811c9286-f779-4143-8458-e9251f3c8756', 'created_at': datetime.datetime(2026, 9, 23, 13, 22, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 22, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/811c9286-f779-4143-8458-e9251f3c8756/file', 'properties': {}}, 'image_service': } Sep 23 15:22:51 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Trying to clone 1bad29b6-41a1-497c-9620-f485af7f5ade from image 811c9286-f779-4143-8458-e9251f3c8756 at location (None, [{'url': 'file:///opt/stack/data/glance/images/811c9286-f779-4143-8458-e9251f3c8756', 'metadata': {}}]). {{(pid=86064) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 15:22:51 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 15:22:51 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Image download 0.00 MB at 0.00 MB/s Sep 23 15:22:51 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b650096-779b-44dc-bc44-91920ec50244]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:51 devstack sudo[103902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD Sep 23 15:22:51 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:52 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD" returned: 0 in 0.594s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:52 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD Sep 23 15:22:52 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:52 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:22:52 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Temporary image 811c9286-f779-4143-8458-e9251f3c8756 is fetched for user 23e271e143164a93bca0875bce42568b. {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 15:22:52 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb935d7-6040-493b-a6db-df5c8427b1b9]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:52 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD Sep 23 15:22:52 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:53 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD" returned: 0 in 0.488s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:53 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD Sep 23 15:22:53 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:53 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD" returned: 1 in 0.396s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:22:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:53 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bad29b6-41a1-497c-9620-f485af7f5ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0608b1e62b48358fa1f46cc7068382',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:22:51Z,use_quota=True,user_id='23e271e143164a93bca0875bce42568b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:22:53 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Creating volume 1bad29b6-41a1-497c-9620-f485af7f5ade {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:22:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:53 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:53 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:53 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:22:53 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:22:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1bad29b6-41a1-497c-9620-f485af7f5ade 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:53 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1bad29b6-41a1-497c-9620-f485af7f5ade 1073741824 Sep 23 15:22:53 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:54 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1bad29b6-41a1-497c-9620-f485af7f5ade 1073741824" returned: 0 in 0.484s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1bad29b6-41a1-497c-9620-f485af7f5ade {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:54 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1bad29b6-41a1-497c-9620-f485af7f5ade Sep 23 15:22:54 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:54 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-447f8144-a336-4870-8a3c-afc4f78f16cd tempest-TestStampPattern-757802660 None] Acquiring lock "cinder-87b68c37-42e3-4232-8775-c79538c4075e-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:54 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-447f8144-a336-4870-8a3c-afc4f78f16cd tempest-TestStampPattern-757802660 None] Lock "cinder-87b68c37-42e3-4232-8775-c79538c4075e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:54 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-447f8144-a336-4870-8a3c-afc4f78f16cd tempest-TestStampPattern-757802660 None] Acquiring lock "cinder-quobyte-87b68c37-42e3-4232-8775-c79538c4075e" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:54 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-447f8144-a336-4870-8a3c-afc4f78f16cd tempest-TestStampPattern-757802660 None] Lock "cinder-quobyte-87b68c37-42e3-4232-8775-c79538c4075e" acquired by "delete_volume" :: waited 0.024s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:54 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e75288f-3d9a-4c0f-a55d-bba3942513fe]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-447f8144-a336-4870-8a3c-afc4f78f16cd tempest-TestStampPattern-757802660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:54 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1bad29b6-41a1-497c-9620-f485af7f5ade" returned: 0 in 0.283s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:22:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:54 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Attempting download of 811c9286-f779-4143-8458-e9251f3c8756 ((None, [{'url': 'file:///opt/stack/data/glance/images/811c9286-f779-4143-8458-e9251f3c8756', 'metadata': {}}])) to volume 1bad29b6-41a1-497c-9620-f485af7f5ade. {{(pid=86064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 15:22:54 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[0baa8566-82f0-4114-bf8b-be5bdd15f0fd]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_811c9286-f779-4143-8458-e9251f3c8756_19a6mgk2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:54 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e Sep 23 15:22:54 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:54 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_811c9286-f779-4143-8458-e9251f3c8756_19a6mgk2 Sep 23 15:22:54 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:54 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-447f8144-a336-4870-8a3c-afc4f78f16cd tempest-TestStampPattern-757802660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e" returned: 0 in 0.450s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-447f8144-a336-4870-8a3c-afc4f78f16cd tempest-TestStampPattern-757802660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:54 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e Sep 23 15:22:54 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:54 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_811c9286-f779-4143-8458-e9251f3c8756_19a6mgk2" returned: 0 in 0.364s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_811c9286-f779-4143-8458-e9251f3c8756_19a6mgk2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:55 devstack sudo[103959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_811c9286-f779-4143-8458-e9251f3c8756_19a6mgk2 Sep 23 15:22:55 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:55 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-447f8144-a336-4870-8a3c-afc4f78f16cd tempest-TestStampPattern-757802660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87b68c37-42e3-4232-8775-c79538c4075e" returned: 0 in 0.258s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:55 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-447f8144-a336-4870-8a3c-afc4f78f16cd tempest-TestStampPattern-757802660 None] Lock "cinder-quobyte-87b68c37-42e3-4232-8775-c79538c4075e" released by "delete_volume" :: held 0.792s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:55 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-447f8144-a336-4870-8a3c-afc4f78f16cd tempest-TestStampPattern-757802660 None] Created reservations ['7376b87d-e9be-4e29-8a09-8786f020c7da', '857fbd77-3483-4a18-aa9d-ec1263934fba', '15341619-f31e-4699-a9c5-10d644861c0f', 'a58170f0-af6b-4070-9285-6ff2d060afb5'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:22:55 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_811c9286-f779-4143-8458-e9251f3c8756_19a6mgk2" returned: 1 in 0.402s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_811c9286-f779-4143-8458-e9251f3c8756_19a6mgk2' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:22:55 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d716ca31-3899-42f9-ae57-e0d0f4b59250]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-447f8144-a336-4870-8a3c-afc4f78f16cd tempest-TestStampPattern-757802660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-447f8144-a336-4870-8a3c-afc4f78f16cd tempest-TestStampPattern-757802660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-447f8144-a336-4870-8a3c-afc4f78f16cd tempest-TestStampPattern-757802660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-447f8144-a336-4870-8a3c-afc4f78f16cd tempest-TestStampPattern-757802660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-447f8144-a336-4870-8a3c-afc4f78f16cd tempest-TestStampPattern-757802660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-447f8144-a336-4870-8a3c-afc4f78f16cd tempest-TestStampPattern-757802660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:55 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:22:55 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:55 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD Sep 23 15:22:55 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:55 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-447f8144-a336-4870-8a3c-afc4f78f16cd tempest-TestStampPattern-757802660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.298s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:55 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-447f8144-a336-4870-8a3c-afc4f78f16cd tempest-TestStampPattern-757802660 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:22:55 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-447f8144-a336-4870-8a3c-afc4f78f16cd tempest-TestStampPattern-757802660 None] Deleted volume successfully. Sep 23 15:22:55 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-447f8144-a336-4870-8a3c-afc4f78f16cd tempest-TestStampPattern-757802660 None] Lock "cinder-87b68c37-42e3-4232-8775-c79538c4075e-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:55 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:55 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD Sep 23 15:22:55 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:56 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD" returned: 1 in 0.379s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:22:56 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] 811c9286-f779-4143-8458-e9251f3c8756 was raw, converting to qcow2 {{(pid=86064) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 15:22:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1bad29b6-41a1-497c-9620-f485af7f5ade {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:56 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1bad29b6-41a1-497c-9620-f485af7f5ade Sep 23 15:22:56 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:56 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1bad29b6-41a1-497c-9620-f485af7f5ade" returned: 0 in 0.537s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:56 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_811c9286-f779-4143-8458-e9251f3c8756_sup87bgsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1bad29b6-41a1-497c-9620-f485af7f5ade {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:22:56 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 15:22:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1bad29b6-41a1-497c-9620-f485af7f5ade 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:56 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1bad29b6-41a1-497c-9620-f485af7f5ade 1G Sep 23 15:22:56 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:57 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1bad29b6-41a1-497c-9620-f485af7f5ade 1G" returned: 0 in 0.394s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:57 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Downloaded image 811c9286-f779-4143-8458-e9251f3c8756 ((None, [{'url': 'file:///opt/stack/data/glance/images/811c9286-f779-4143-8458-e9251f3c8756', 'metadata': {}}])) to volume 1bad29b6-41a1-497c-9620-f485af7f5ade successfully. {{(pid=86064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 15:22:57 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Temporary image 811c9286-f779-4143-8458-e9251f3c8756 for user 23e271e143164a93bca0875bce42568b is deleted. {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 15:22:57 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Marking volume 1bad29b6-41a1-497c-9620-f485af7f5ade as bootable. {{(pid=86064) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 15:22:57 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Copying metadata from image 811c9286-f779-4143-8458-e9251f3c8756 to 1bad29b6-41a1-497c-9620-f485af7f5ade. {{(pid=86064) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 15:22:57 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Creating volume glance metadata for volume 1bad29b6-41a1-497c-9620-f485af7f5ade backed by image 811c9286-f779-4143-8458-e9251f3c8756 with: {'image_id': '811c9286-f779-4143-8458-e9251f3c8756', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9ad441afa1f4275a5992aadf5e568237', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86064) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 15:22:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79fb441f-a3b2-4606-b4e5-0712db56a30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bad29b6-41a1-497c-9620-f485af7f5ade', 'volume_size': 1, 'image_id': '811c9286-f779-4143-8458-e9251f3c8756', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/811c9286-f779-4143-8458-e9251f3c8756', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9ad441afa1f4275a5992aadf5e568237', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0f0608b1e62b48358fa1f46cc7068382', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dbc98dcb42b848396e0b26dea4e693b86b30bda730b30d11ef8561ed337b2ddef8f046ea1dafdf2a60ad8b11914b57203e64c011e391a10fe3ab50ee88afb19e', 'id': '811c9286-f779-4143-8458-e9251f3c8756', 'created_at': datetime.datetime(2026, 9, 23, 13, 22, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 22, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/811c9286-f779-4143-8458-e9251f3c8756/file', 'properties': {}}, 'image_service': }' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7bd50c7-38dc-4b32-a8df-5c7b8ccb5baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:22:57 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Volume volume-1bad29b6-41a1-497c-9620-f485af7f5ade (1bad29b6-41a1-497c-9620-f485af7f5ade): created successfully Sep 23 15:22:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7bd50c7-38dc-4b32-a8df-5c7b8ccb5baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:22:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Flow 'volume_create_manager' (83b184d6-b1a0-4fb4-a989-535d9683cec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:22:57 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-79fdb6b2-732b-48b3-b0ca-f6de7bd0b474 tempest-VolumeImageDependencyTests-990090303 None] Created volume successfully. Sep 23 15:22:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6a43a708-bd96-41e3-8640-5b896d39cc3c tempest-VolumeImageDependencyTests-990090303 None] Acquiring lock "cinder-1bad29b6-41a1-497c-9620-f485af7f5ade-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6a43a708-bd96-41e3-8640-5b896d39cc3c tempest-VolumeImageDependencyTests-990090303 None] Lock "cinder-1bad29b6-41a1-497c-9620-f485af7f5ade-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6a43a708-bd96-41e3-8640-5b896d39cc3c tempest-VolumeImageDependencyTests-990090303 None] Acquiring lock "cinder-quobyte-1bad29b6-41a1-497c-9620-f485af7f5ade" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6a43a708-bd96-41e3-8640-5b896d39cc3c tempest-VolumeImageDependencyTests-990090303 None] Lock "cinder-quobyte-1bad29b6-41a1-497c-9620-f485af7f5ade" acquired by "delete_volume" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:58 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d45f692-5b35-4500-bbd2-988cabd56225]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6a43a708-bd96-41e3-8640-5b896d39cc3c tempest-VolumeImageDependencyTests-990090303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1bad29b6-41a1-497c-9620-f485af7f5ade {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:58 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1bad29b6-41a1-497c-9620-f485af7f5ade Sep 23 15:22:58 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:59 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6a43a708-bd96-41e3-8640-5b896d39cc3c tempest-VolumeImageDependencyTests-990090303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1bad29b6-41a1-497c-9620-f485af7f5ade" returned: 0 in 0.498s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6a43a708-bd96-41e3-8640-5b896d39cc3c tempest-VolumeImageDependencyTests-990090303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1bad29b6-41a1-497c-9620-f485af7f5ade {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:59 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1bad29b6-41a1-497c-9620-f485af7f5ade Sep 23 15:22:59 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-037588fe-0c32-4d2d-a241-201e5ea0c4e1 tempest-VolumesNegativeTest-613788903 None] Acquiring lock "cinder-9747b20b-865b-49e3-9081-a0736a3c366e-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-037588fe-0c32-4d2d-a241-201e5ea0c4e1 tempest-VolumesNegativeTest-613788903 None] Lock "cinder-9747b20b-865b-49e3-9081-a0736a3c366e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:59 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6a43a708-bd96-41e3-8640-5b896d39cc3c tempest-VolumeImageDependencyTests-990090303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-1bad29b6-41a1-497c-9620-f485af7f5ade" returned: 0 in 0.278s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-037588fe-0c32-4d2d-a241-201e5ea0c4e1 tempest-VolumesNegativeTest-613788903 None] Acquiring lock "cinder-quobyte-9747b20b-865b-49e3-9081-a0736a3c366e" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:22:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6a43a708-bd96-41e3-8640-5b896d39cc3c tempest-VolumeImageDependencyTests-990090303 None] Lock "cinder-quobyte-1bad29b6-41a1-497c-9620-f485af7f5ade" released by "delete_volume" :: held 0.833s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-037588fe-0c32-4d2d-a241-201e5ea0c4e1 tempest-VolumesNegativeTest-613788903 None] Lock "cinder-quobyte-9747b20b-865b-49e3-9081-a0736a3c366e" acquired by "delete_volume" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:22:59 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f489c4-f748-47c1-8169-5a07beb57273]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:22:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-037588fe-0c32-4d2d-a241-201e5ea0c4e1 tempest-VolumesNegativeTest-613788903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9747b20b-865b-49e3-9081-a0736a3c366e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:59 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-6a43a708-bd96-41e3-8640-5b896d39cc3c tempest-VolumeImageDependencyTests-990090303 None] Created reservations ['d847ac7e-94ff-4fd0-93fa-407f6c8a9848', '22f55863-8187-47e1-9206-932f55b12c33', '0850ea84-2170-4d80-b5b2-8d0954db92d2', '3e55b43d-5396-4572-be8b-5221ccbc84bd'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:22:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6a43a708-bd96-41e3-8640-5b896d39cc3c tempest-VolumeImageDependencyTests-990090303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:22:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6a43a708-bd96-41e3-8640-5b896d39cc3c tempest-VolumeImageDependencyTests-990090303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:22:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6a43a708-bd96-41e3-8640-5b896d39cc3c tempest-VolumeImageDependencyTests-990090303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:22:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6a43a708-bd96-41e3-8640-5b896d39cc3c tempest-VolumeImageDependencyTests-990090303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:22:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6a43a708-bd96-41e3-8640-5b896d39cc3c tempest-VolumeImageDependencyTests-990090303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:22:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6a43a708-bd96-41e3-8640-5b896d39cc3c tempest-VolumeImageDependencyTests-990090303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:59 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9747b20b-865b-49e3-9081-a0736a3c366e Sep 23 15:22:59 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:59 devstack sudo[104000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:22:59 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:22:59 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6a43a708-bd96-41e3-8640-5b896d39cc3c tempest-VolumeImageDependencyTests-990090303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.305s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:59 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-6a43a708-bd96-41e3-8640-5b896d39cc3c tempest-VolumeImageDependencyTests-990090303 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:22:59 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-6a43a708-bd96-41e3-8640-5b896d39cc3c tempest-VolumeImageDependencyTests-990090303 None] Deleted volume successfully. Sep 23 15:22:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6a43a708-bd96-41e3-8640-5b896d39cc3c tempest-VolumeImageDependencyTests-990090303 None] Lock "cinder-1bad29b6-41a1-497c-9620-f485af7f5ade-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:22:59 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Sep 23 15:22:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-037588fe-0c32-4d2d-a241-201e5ea0c4e1 tempest-VolumesNegativeTest-613788903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9747b20b-865b-49e3-9081-a0736a3c366e" returned: 0 in 0.495s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:22:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-037588fe-0c32-4d2d-a241-201e5ea0c4e1 tempest-VolumesNegativeTest-613788903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9747b20b-865b-49e3-9081-a0736a3c366e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:22:59 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9747b20b-865b-49e3-9081-a0736a3c366e Sep 23 15:22:59 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:00 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-037588fe-0c32-4d2d-a241-201e5ea0c4e1 tempest-VolumesNegativeTest-613788903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9747b20b-865b-49e3-9081-a0736a3c366e" returned: 0 in 0.313s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:00 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-037588fe-0c32-4d2d-a241-201e5ea0c4e1 tempest-VolumesNegativeTest-613788903 None] Lock "cinder-quobyte-9747b20b-865b-49e3-9081-a0736a3c366e" released by "delete_volume" :: held 0.861s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:00 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-037588fe-0c32-4d2d-a241-201e5ea0c4e1 tempest-VolumesNegativeTest-613788903 None] Created reservations ['e41e6f41-c6ab-46ff-b5e5-209373e3bc78', 'c62c5769-1736-41bf-848e-3c2c5c0bc8db', '407e426b-e5f9-4dfd-ad3b-368cc200279e', '469db639-6f54-4eab-9f9e-ba510aa25f18'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:23:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-037588fe-0c32-4d2d-a241-201e5ea0c4e1 tempest-VolumesNegativeTest-613788903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-037588fe-0c32-4d2d-a241-201e5ea0c4e1 tempest-VolumesNegativeTest-613788903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-037588fe-0c32-4d2d-a241-201e5ea0c4e1 tempest-VolumesNegativeTest-613788903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:23:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-037588fe-0c32-4d2d-a241-201e5ea0c4e1 tempest-VolumesNegativeTest-613788903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:23:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-037588fe-0c32-4d2d-a241-201e5ea0c4e1 tempest-VolumesNegativeTest-613788903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-037588fe-0c32-4d2d-a241-201e5ea0c4e1 tempest-VolumesNegativeTest-613788903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:00 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:23:00 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:00 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-037588fe-0c32-4d2d-a241-201e5ea0c4e1 tempest-VolumesNegativeTest-613788903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.321s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:00 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-037588fe-0c32-4d2d-a241-201e5ea0c4e1 tempest-VolumesNegativeTest-613788903 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:23:00 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-037588fe-0c32-4d2d-a241-201e5ea0c4e1 tempest-VolumesNegativeTest-613788903 None] Deleted volume successfully. Sep 23 15:23:00 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-037588fe-0c32-4d2d-a241-201e5ea0c4e1 tempest-VolumesNegativeTest-613788903 None] Lock "cinder-9747b20b-865b-49e3-9081-a0736a3c366e-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:05 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:23:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Flow 'volume_create_manager' (b462a0dd-6b02-474c-beb7-c67b1e5884c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:23:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b13e67-ec69-47f9-a904-f0438181052b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b13e67-ec69-47f9-a904-f0438181052b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1362819122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f44c05d-a5c0-475c-8b35-43873d56055a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023e0aa7cb794da29df3965bde834dfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:23:05Z,use_quota=True,user_id='308a607aff8443b6839a205075815a69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff419544-9fb6-44d5-8bbb-399502b36927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff419544-9fb6-44d5-8bbb-399502b36927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7859c49-0580-4214-aa65-c08093321215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7859c49-0580-4214-aa65-c08093321215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f44c05d-a5c0-475c-8b35-43873d56055a', 'volume_name': 'volume-4f44c05d-a5c0-475c-8b35-43873d56055a', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13aa8eef-9b4e-4231-a5b7-755bb8b89907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13aa8eef-9b4e-4231-a5b7-755bb8b89907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6727eed-4007-459c-a805-6f45d38bc215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:05 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Volume 4f44c05d-a5c0-475c-8b35-43873d56055a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f44c05d-a5c0-475c-8b35-43873d56055a', 'volume_size': 1} Sep 23 15:23:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1362819122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f44c05d-a5c0-475c-8b35-43873d56055a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023e0aa7cb794da29df3965bde834dfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:23:05Z,use_quota=True,user_id='308a607aff8443b6839a205075815a69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:23:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Creating volume 4f44c05d-a5c0-475c-8b35-43873d56055a {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:23:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:23:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:23:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:23:05 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:23:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:05 devstack sudo[104015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a 1073741824 Sep 23 15:23:05 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:06 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a 1073741824" returned: 0 in 0.558s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:06 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a Sep 23 15:23:06 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:06 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a" returned: 0 in 0.349s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:23:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6727eed-4007-459c-a805-6f45d38bc215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f44c05d-a5c0-475c-8b35-43873d56055a', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eba7579-0fd4-4c50-a58c-dc9e4ccb5c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:06 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Volume volume-4f44c05d-a5c0-475c-8b35-43873d56055a (4f44c05d-a5c0-475c-8b35-43873d56055a): created successfully Sep 23 15:23:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eba7579-0fd4-4c50-a58c-dc9e4ccb5c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Flow 'volume_create_manager' (b462a0dd-6b02-474c-beb7-c67b1e5884c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:23:06 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-08ab4a5d-5239-4d8f-943c-fb224e12348f tempest-VolumesSnapshotListTestJSON-1746937130 None] Created volume successfully. Sep 23 15:23:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6ecdd600-4ca0-498c-b668-9f441e82d692 tempest-VolumesSnapshotListTestJSON-1746937130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6ecdd600-4ca0-498c-b668-9f441e82d692 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-6ecdd600-4ca0-498c-b668-9f441e82d692 tempest-VolumesSnapshotListTestJSON-1746937130 None] Creating offline snapshot cfc4fc4a-67ca-4e65-8f2a-665330813f14 of volume 4f44c05d-a5c0-475c-8b35-43873d56055a {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:23:07 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9397bbdc-8361-4122-ba69-3a9ffa9830a6]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6ecdd600-4ca0-498c-b668-9f441e82d692 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:07 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a Sep 23 15:23:07 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:08 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6ecdd600-4ca0-498c-b668-9f441e82d692 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a" returned: 0 in 0.424s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6ecdd600-4ca0-498c-b668-9f441e82d692 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:08 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14 1G Sep 23 15:23:08 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:08 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6ecdd600-4ca0-498c-b668-9f441e82d692 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14 1G" returned: 0 in 0.549s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6ecdd600-4ca0-498c-b668-9f441e82d692 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f44c05d-a5c0-475c-8b35-43873d56055a -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:08 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f44c05d-a5c0-475c-8b35-43873d56055a -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14 Sep 23 15:23:08 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:08 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6ecdd600-4ca0-498c-b668-9f441e82d692 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f44c05d-a5c0-475c-8b35-43873d56055a -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14" returned: 0 in 0.311s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:08 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-6ecdd600-4ca0-498c-b668-9f441e82d692 tempest-VolumesSnapshotListTestJSON-1746937130 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14 is being set with open permissions: ugo+rw Sep 23 15:23:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6ecdd600-4ca0-498c-b668-9f441e82d692 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:09 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14 Sep 23 15:23:09 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:09 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6ecdd600-4ca0-498c-b668-9f441e82d692 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14" returned: 0 in 0.257s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6ecdd600-4ca0-498c-b668-9f441e82d692 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:09 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.info Sep 23 15:23:09 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:09 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6ecdd600-4ca0-498c-b668-9f441e82d692 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.info" returned: 0 in 0.266s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:09 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-6ecdd600-4ca0-498c-b668-9f441e82d692 tempest-VolumesSnapshotListTestJSON-1746937130 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.info is being set with open permissions: ugo+rw Sep 23 15:23:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6ecdd600-4ca0-498c-b668-9f441e82d692 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:09 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.info Sep 23 15:23:09 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:09 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6ecdd600-4ca0-498c-b668-9f441e82d692 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.info" returned: 0 in 0.259s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6ecdd600-4ca0-498c-b668-9f441e82d692 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.191s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:09 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-6ecdd600-4ca0-498c-b668-9f441e82d692 tempest-VolumesSnapshotListTestJSON-1746937130 None] Create snapshot completed successfully Sep 23 15:23:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8bf4ccf8-37fa-4d49-80fe-269c5c391985 tempest-VolumesSnapshotListTestJSON-1746937130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8bf4ccf8-37fa-4d49-80fe-269c5c391985 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-8bf4ccf8-37fa-4d49-80fe-269c5c391985 tempest-VolumesSnapshotListTestJSON-1746937130 None] Creating offline snapshot 970962b3-9bf7-47b1-9417-6a8cd383b72a of volume 4f44c05d-a5c0-475c-8b35-43873d56055a {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:23:11 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cb97e8-93ed-45b0-bc0b-9d187cc4042a]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8bf4ccf8-37fa-4d49-80fe-269c5c391985 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:11 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14 Sep 23 15:23:11 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:11 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8bf4ccf8-37fa-4d49-80fe-269c5c391985 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14" returned: 0 in 0.379s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-8bf4ccf8-37fa-4d49-80fe-269c5c391985 tempest-VolumesSnapshotListTestJSON-1746937130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f44c05d-a5c0-475c-8b35-43873d56055a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:23:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8bf4ccf8-37fa-4d49-80fe-269c5c391985 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:11 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a 1G Sep 23 15:23:11 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:11 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8bf4ccf8-37fa-4d49-80fe-269c5c391985 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a 1G" returned: 0 in 0.461s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8bf4ccf8-37fa-4d49-80fe-269c5c391985 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:11 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a Sep 23 15:23:11 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:12 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8bf4ccf8-37fa-4d49-80fe-269c5c391985 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a" returned: 0 in 0.310s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:12 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-8bf4ccf8-37fa-4d49-80fe-269c5c391985 tempest-VolumesSnapshotListTestJSON-1746937130 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a is being set with open permissions: ugo+rw Sep 23 15:23:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8bf4ccf8-37fa-4d49-80fe-269c5c391985 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:12 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a Sep 23 15:23:12 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:12 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8bf4ccf8-37fa-4d49-80fe-269c5c391985 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a" returned: 0 in 0.265s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8bf4ccf8-37fa-4d49-80fe-269c5c391985 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.519s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:12 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-8bf4ccf8-37fa-4d49-80fe-269c5c391985 tempest-VolumesSnapshotListTestJSON-1746937130 None] Create snapshot completed successfully Sep 23 15:23:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-df9f7dd5-dad6-4567-b185-dfdc7a305fe7 tempest-VolumesSnapshotListTestJSON-1746937130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-df9f7dd5-dad6-4567-b185-dfdc7a305fe7 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-df9f7dd5-dad6-4567-b185-dfdc7a305fe7 tempest-VolumesSnapshotListTestJSON-1746937130 None] Creating offline snapshot 34cc6824-ace1-41dd-893c-ffee937944fe of volume 4f44c05d-a5c0-475c-8b35-43873d56055a {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:23:13 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7644e91-35ff-4f45-af7c-1ff6e0440366]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-df9f7dd5-dad6-4567-b185-dfdc7a305fe7 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:13 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a Sep 23 15:23:13 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:13 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:23:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Flow 'volume_create_manager' (60199b41-0dea-4342-8db8-c5a274cdd10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:23:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91c5bef-b2dc-4896-92a2-ebeee3938b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:13 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-df9f7dd5-dad6-4567-b185-dfdc7a305fe7 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a" returned: 0 in 0.403s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-df9f7dd5-dad6-4567-b185-dfdc7a305fe7 tempest-VolumesSnapshotListTestJSON-1746937130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f44c05d-a5c0-475c-8b35-43873d56055a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:23:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-df9f7dd5-dad6-4567-b185-dfdc7a305fe7 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.34cc6824-ace1-41dd-893c-ffee937944fe 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91c5bef-b2dc-4896-92a2-ebeee3938b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d371d03-e57a-4c4d-beff-780c737ed372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae9a84a4a3064c32ac7ce3297ef9a9b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:23:14Z,use_quota=True,user_id='00d77ce34d6341479517af0aae045c81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15200392-d55a-42be-890b-38dd1c756394),volume_type_id=15200392-d55a-42be-890b-38dd1c756394)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (238f7a36-4063-4eae-b72a-dd63afd98540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:13 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.34cc6824-ace1-41dd-893c-ffee937944fe 1G Sep 23 15:23:13 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (238f7a36-4063-4eae-b72a-dd63afd98540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d23f75a-d707-4537-ae77-12f2715c8a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:13 devstack cinder-volume[86064]: DEBUG cinder.image.glance [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Creating Keystone auth plugin from conf {{(pid=86064) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 15:23:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d23f75a-d707-4537-ae77-12f2715c8a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3d371d03-e57a-4c4d-beff-780c737ed372', 'volume_name': 'volume-3d371d03-e57a-4c4d-beff-780c737ed372', 'volume_size': 1, 'image_id': '2d3faf5e-19c2-4de4-be77-6dbfc02443c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d3faf5e-19c2-4de4-be77-6dbfc02443c9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '107c22f48b63122241a20e15098d7dc2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ae9a84a4a3064c32ac7ce3297ef9a9b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '85ef9ef9051bf04bf12e25d597e0742cb49c0bc4a32618168bb586d339025453f5f20f6b3868c501e39403e491de6043bafdf9ffea2175bd680a1fb79f272b13', 'id': '2d3faf5e-19c2-4de4-be77-6dbfc02443c9', 'created_at': datetime.datetime(2026, 9, 23, 13, 23, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 23, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d3faf5e-19c2-4de4-be77-6dbfc02443c9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5544bf9-e221-412d-b861-5ca2388832a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5544bf9-e221-412d-b861-5ca2388832a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26614445-f266-4df0-a104-2f327991caa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:13 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Volume 3d371d03-e57a-4c4d-beff-780c737ed372: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3d371d03-e57a-4c4d-beff-780c737ed372', 'volume_size': 1, 'image_id': '2d3faf5e-19c2-4de4-be77-6dbfc02443c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d3faf5e-19c2-4de4-be77-6dbfc02443c9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '107c22f48b63122241a20e15098d7dc2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ae9a84a4a3064c32ac7ce3297ef9a9b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '85ef9ef9051bf04bf12e25d597e0742cb49c0bc4a32618168bb586d339025453f5f20f6b3868c501e39403e491de6043bafdf9ffea2175bd680a1fb79f272b13', 'id': '2d3faf5e-19c2-4de4-be77-6dbfc02443c9', 'created_at': datetime.datetime(2026, 9, 23, 13, 23, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 23, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d3faf5e-19c2-4de4-be77-6dbfc02443c9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 23 15:23:13 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Trying to clone 3d371d03-e57a-4c4d-beff-780c737ed372 from image 2d3faf5e-19c2-4de4-be77-6dbfc02443c9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2d3faf5e-19c2-4de4-be77-6dbfc02443c9', 'metadata': {}}]). {{(pid=86064) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 15:23:14 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 15:23:14 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Image download 0.00 MB at 0.00 MB/s Sep 23 15:23:14 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2214d6-d049-47fe-b57c-d854bf816213]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:14 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-df9f7dd5-dad6-4567-b185-dfdc7a305fe7 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.34cc6824-ace1-41dd-893c-ffee937944fe 1G" returned: 0 in 0.511s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-df9f7dd5-dad6-4567-b185-dfdc7a305fe7 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.34cc6824-ace1-41dd-893c-ffee937944fe {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:14 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD Sep 23 15:23:14 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:14 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.34cc6824-ace1-41dd-893c-ffee937944fe Sep 23 15:23:14 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:14 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:14 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-df9f7dd5-dad6-4567-b185-dfdc7a305fe7 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.34cc6824-ace1-41dd-893c-ffee937944fe" returned: 0 in 0.301s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:14 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-df9f7dd5-dad6-4567-b185-dfdc7a305fe7 tempest-VolumesSnapshotListTestJSON-1746937130 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.34cc6824-ace1-41dd-893c-ffee937944fe is being set with open permissions: ugo+rw Sep 23 15:23:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-df9f7dd5-dad6-4567-b185-dfdc7a305fe7 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.34cc6824-ace1-41dd-893c-ffee937944fe {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:14 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.34cc6824-ace1-41dd-893c-ffee937944fe Sep 23 15:23:14 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:14 devstack sudo[104094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD Sep 23 15:23:14 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:14 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-df9f7dd5-dad6-4567-b185-dfdc7a305fe7 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.34cc6824-ace1-41dd-893c-ffee937944fe" returned: 0 in 0.246s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:14 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-df9f7dd5-dad6-4567-b185-dfdc7a305fe7 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.575s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:23:14 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Temporary image 2d3faf5e-19c2-4de4-be77-6dbfc02443c9 is fetched for user 00d77ce34d6341479517af0aae045c81. {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 15:23:14 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-df9f7dd5-dad6-4567-b185-dfdc7a305fe7 tempest-VolumesSnapshotListTestJSON-1746937130 None] Create snapshot completed successfully Sep 23 15:23:14 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66ad280-0327-4deb-8e46-4082e35959fa]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:14 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD Sep 23 15:23:14 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:15 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:15 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD Sep 23 15:23:15 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:15 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD" returned: 1 in 0.339s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:23:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d371d03-e57a-4c4d-beff-780c737ed372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae9a84a4a3064c32ac7ce3297ef9a9b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:23:14Z,use_quota=True,user_id='00d77ce34d6341479517af0aae045c81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15200392-d55a-42be-890b-38dd1c756394),volume_type_id=15200392-d55a-42be-890b-38dd1c756394)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:23:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Creating volume 3d371d03-e57a-4c4d-beff-780c737ed372 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:23:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:23:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:23:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:23:15 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:23:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3d371d03-e57a-4c4d-beff-780c737ed372 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:15 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3d371d03-e57a-4c4d-beff-780c737ed372 1073741824 Sep 23 15:23:15 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:16 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3d371d03-e57a-4c4d-beff-780c737ed372 1073741824" returned: 0 in 0.464s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3d371d03-e57a-4c4d-beff-780c737ed372 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:16 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3d371d03-e57a-4c4d-beff-780c737ed372 Sep 23 15:23:16 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] Acquiring lock "cinder-34cc6824-ace1-41dd-893c-ffee937944fe-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "cinder-34cc6824-ace1-41dd-893c-ffee937944fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] Acquiring lock "cinder-quobyte-4f44c05d-a5c0-475c-8b35-43873d56055a" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "cinder-quobyte-4f44c05d-a5c0-475c-8b35-43873d56055a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] Acquiring lock "cinder-quobyte-34cc6824-ace1-41dd-893c-ffee937944fe" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "cinder-quobyte-34cc6824-ace1-41dd-893c-ffee937944fe" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] Deleting offline snapshot 34cc6824-ace1-41dd-893c-ffee937944fe of volume 4f44c05d-a5c0-475c-8b35-43873d56055a {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:23:16 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] snapshot_file for this snap is: volume-4f44c05d-a5c0-475c-8b35-43873d56055a.34cc6824-ace1-41dd-893c-ffee937944fe {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3d371d03-e57a-4c4d-beff-780c737ed372" returned: 0 in 0.290s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[770c2ce5-117a-4ef1-986b-455b8212c6cb]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.34cc6824-ace1-41dd-893c-ffee937944fe {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Attempting download of 2d3faf5e-19c2-4de4-be77-6dbfc02443c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d3faf5e-19c2-4de4-be77-6dbfc02443c9', 'metadata': {}}])) to volume 3d371d03-e57a-4c4d-beff-780c737ed372. {{(pid=86064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab4c130-49ed-41dc-9d6f-26926c4cba6e]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_nx38x4dn {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:16 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.34cc6824-ace1-41dd-893c-ffee937944fe Sep 23 15:23:16 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:16 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_nx38x4dn Sep 23 15:23:16 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:16 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.34cc6824-ace1-41dd-893c-ffee937944fe" returned: 0 in 0.388s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f44c05d-a5c0-475c-8b35-43873d56055a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfb43c8-2f17-4e26-aa4c-06f793975ff0]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:16 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_nx38x4dn" returned: 0 in 0.354s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_nx38x4dn {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:16 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a Sep 23 15:23:16 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:16 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_nx38x4dn Sep 23 15:23:16 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:17 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_nx38x4dn" returned: 1 in 0.346s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_nx38x4dn' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:23:17 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd353cc8-8ff4-4195-a1ec-21c2072f2884]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:17 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a" returned: 0 in 0.380s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f44c05d-a5c0-475c-8b35-43873d56055a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:23:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.34cc6824-ace1-41dd-893c-ffee937944fe {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:17 devstack sudo[104140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.34cc6824-ace1-41dd-893c-ffee937944fe Sep 23 15:23:17 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:17 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD Sep 23 15:23:17 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:17 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:17 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.34cc6824-ace1-41dd-893c-ffee937944fe" returned: 0 in 0.426s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.34cc6824-ace1-41dd-893c-ffee937944fe {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:17 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD Sep 23 15:23:17 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:17 devstack sudo[104149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.34cc6824-ace1-41dd-893c-ffee937944fe Sep 23 15:23:17 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:17 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.34cc6824-ace1-41dd-893c-ffee937944fe" returned: 0 in 0.261s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:17 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD" returned: 1 in 0.374s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:23:17 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] 2d3faf5e-19c2-4de4-be77-6dbfc02443c9 was raw, converting to qcow2 {{(pid=86064) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 15:23:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3d371d03-e57a-4c4d-beff-780c737ed372 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "cinder-quobyte-34cc6824-ace1-41dd-893c-ffee937944fe" released by "_delete_snapshot" :: held 1.577s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "cinder-quobyte-4f44c05d-a5c0-475c-8b35-43873d56055a" released by "delete_snapshot" :: held 1.610s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:17 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3d371d03-e57a-4c4d-beff-780c737ed372 Sep 23 15:23:17 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:17 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] Created reservations ['0dbda00e-50d0-4a83-b8f0-730114d2bcfc', 'c6b29b79-b491-4bbe-843c-8ebea44b3443', '1014ead5-8454-478d-9883-81e097c277ad', '5576681d-0319-48d4-958e-d0373eca86e6'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:23:18 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] Delete snapshot completed successfully. Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f4329240-6c9d-421d-8ac5-e17ecf41e4ef tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "cinder-34cc6824-ace1-41dd-893c-ffee937944fe-delete_snapshot" released by "delete_snapshot" :: held 1.761s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:18 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3d371d03-e57a-4c4d-beff-780c737ed372" returned: 0 in 0.469s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2d3faf5e-19c2-4de4-be77-6dbfc02443c9_94bjqfgldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3d371d03-e57a-4c4d-beff-780c737ed372 {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:23:18 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3d371d03-e57a-4c4d-beff-780c737ed372 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:18 devstack sudo[104162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3d371d03-e57a-4c4d-beff-780c737ed372 1G Sep 23 15:23:18 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] Acquiring lock "cinder-970962b3-9bf7-47b1-9417-6a8cd383b72a-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "cinder-970962b3-9bf7-47b1-9417-6a8cd383b72a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] Acquiring lock "cinder-quobyte-4f44c05d-a5c0-475c-8b35-43873d56055a" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "cinder-quobyte-4f44c05d-a5c0-475c-8b35-43873d56055a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] Acquiring lock "cinder-quobyte-970962b3-9bf7-47b1-9417-6a8cd383b72a" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "cinder-quobyte-970962b3-9bf7-47b1-9417-6a8cd383b72a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] Deleting offline snapshot 970962b3-9bf7-47b1-9417-6a8cd383b72a of volume 4f44c05d-a5c0-475c-8b35-43873d56055a {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] snapshot_file for this snap is: volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[db10bb70-2af1-44ce-b42b-eaa5c34940ff]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:18 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a Sep 23 15:23:18 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:18 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3d371d03-e57a-4c4d-beff-780c737ed372 1G" returned: 0 in 0.343s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Downloaded image 2d3faf5e-19c2-4de4-be77-6dbfc02443c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d3faf5e-19c2-4de4-be77-6dbfc02443c9', 'metadata': {}}])) to volume 3d371d03-e57a-4c4d-beff-780c737ed372 successfully. {{(pid=86064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Temporary image 2d3faf5e-19c2-4de4-be77-6dbfc02443c9 for user 00d77ce34d6341479517af0aae045c81 is deleted. {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Marking volume 3d371d03-e57a-4c4d-beff-780c737ed372 as bootable. {{(pid=86064) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Copying metadata from image 2d3faf5e-19c2-4de4-be77-6dbfc02443c9 to 3d371d03-e57a-4c4d-beff-780c737ed372. {{(pid=86064) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Creating volume glance metadata for volume 3d371d03-e57a-4c4d-beff-780c737ed372 backed by image 2d3faf5e-19c2-4de4-be77-6dbfc02443c9 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2d3faf5e-19c2-4de4-be77-6dbfc02443c9', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '107c22f48b63122241a20e15098d7dc2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86064) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26614445-f266-4df0-a104-2f327991caa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d371d03-e57a-4c4d-beff-780c737ed372', 'volume_size': 1, 'image_id': '2d3faf5e-19c2-4de4-be77-6dbfc02443c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d3faf5e-19c2-4de4-be77-6dbfc02443c9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '107c22f48b63122241a20e15098d7dc2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ae9a84a4a3064c32ac7ce3297ef9a9b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '85ef9ef9051bf04bf12e25d597e0742cb49c0bc4a32618168bb586d339025453f5f20f6b3868c501e39403e491de6043bafdf9ffea2175bd680a1fb79f272b13', 'id': '2d3faf5e-19c2-4de4-be77-6dbfc02443c9', 'created_at': datetime.datetime(2026, 9, 23, 13, 23, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 23, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d3faf5e-19c2-4de4-be77-6dbfc02443c9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2631f601-252c-4b0e-bf7f-faf0041bbb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:18 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Volume volume-3d371d03-e57a-4c4d-beff-780c737ed372 (3d371d03-e57a-4c4d-beff-780c737ed372): created successfully Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2631f601-252c-4b0e-bf7f-faf0041bbb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Flow 'volume_create_manager' (60199b41-0dea-4342-8db8-c5a274cdd10b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:23:18 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-c7fc23af-2ac7-455b-a0a5-a55352810c3f tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Created volume successfully. Sep 23 15:23:18 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a" returned: 0 in 0.420s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f44c05d-a5c0-475c-8b35-43873d56055a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-574f8231-7834-4ecc-9f75-233277fded07 tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Acquiring lock "cinder-3d371d03-e57a-4c4d-beff-780c737ed372-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbc1d75-ffc7-418b-af57-24e8241ee27e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-574f8231-7834-4ecc-9f75-233277fded07 tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Lock "cinder-3d371d03-e57a-4c4d-beff-780c737ed372-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-574f8231-7834-4ecc-9f75-233277fded07 tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Acquiring lock "cinder-quobyte-3d371d03-e57a-4c4d-beff-780c737ed372" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-574f8231-7834-4ecc-9f75-233277fded07 tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Lock "cinder-quobyte-3d371d03-e57a-4c4d-beff-780c737ed372" acquired by "delete_volume" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:19 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c85c41-cf74-4fca-a9e8-fba084377fb4]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-574f8231-7834-4ecc-9f75-233277fded07 tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3d371d03-e57a-4c4d-beff-780c737ed372 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:19 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14 Sep 23 15:23:19 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:19 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3d371d03-e57a-4c4d-beff-780c737ed372 Sep 23 15:23:19 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:19 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14" returned: 0 in 0.409s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f44c05d-a5c0-475c-8b35-43873d56055a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:23:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:19 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a Sep 23 15:23:19 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:19 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-574f8231-7834-4ecc-9f75-233277fded07 tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3d371d03-e57a-4c4d-beff-780c737ed372" returned: 0 in 0.406s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-574f8231-7834-4ecc-9f75-233277fded07 tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3d371d03-e57a-4c4d-beff-780c737ed372 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:19 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3d371d03-e57a-4c4d-beff-780c737ed372 Sep 23 15:23:19 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:19 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-574f8231-7834-4ecc-9f75-233277fded07 tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3d371d03-e57a-4c4d-beff-780c737ed372" returned: 0 in 0.258s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-574f8231-7834-4ecc-9f75-233277fded07 tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Lock "cinder-quobyte-3d371d03-e57a-4c4d-beff-780c737ed372" released by "delete_volume" :: held 0.703s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:19 devstack cinder-volume[86064]: WARNING cinder.quota [None req-574f8231-7834-4ecc-9f75-233277fded07 tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:23:19 devstack cinder-volume[86064]: WARNING cinder.quota [None req-574f8231-7834-4ecc-9f75-233277fded07 tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 23 15:23:19 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a" returned: 0 in 0.391s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:19 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a Sep 23 15:23:19 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:19 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-574f8231-7834-4ecc-9f75-233277fded07 tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Created reservations ['47fb625c-1d54-4e61-9d97-651d0f836358', '3a8d199c-138c-49e7-9ad2-2d55ba741d3e', '28978955-eb8b-4e6a-b8f0-7e8a530f336a', 'eb9a86c8-fe38-4a16-9d6a-34903c0dd6b7'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:23:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-574f8231-7834-4ecc-9f75-233277fded07 tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-574f8231-7834-4ecc-9f75-233277fded07 tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-574f8231-7834-4ecc-9f75-233277fded07 tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:23:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-574f8231-7834-4ecc-9f75-233277fded07 tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:23:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-574f8231-7834-4ecc-9f75-233277fded07 tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-574f8231-7834-4ecc-9f75-233277fded07 tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:19 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:23:19 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:20 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.970962b3-9bf7-47b1-9417-6a8cd383b72a" returned: 0 in 0.274s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "cinder-quobyte-970962b3-9bf7-47b1-9417-6a8cd383b72a" released by "_delete_snapshot" :: held 1.643s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "cinder-quobyte-4f44c05d-a5c0-475c-8b35-43873d56055a" released by "delete_snapshot" :: held 1.670s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:20 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-574f8231-7834-4ecc-9f75-233277fded07 tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.285s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:20 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-574f8231-7834-4ecc-9f75-233277fded07 tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:23:20 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-574f8231-7834-4ecc-9f75-233277fded07 tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Deleted volume successfully. Sep 23 15:23:20 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] Created reservations ['9974e746-a510-411d-b274-c29e963e2936', 'fcfd49c9-f6df-4705-9903-e1626b3042f4', '30d83692-db09-4e8b-b8aa-343d938f2ea6', '694c0a5a-0739-4067-ac1b-19d89bc7d655'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:23:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-574f8231-7834-4ecc-9f75-233277fded07 tempest-VolumeAndVolumeTypeFromImageTest-811401820 None] Lock "cinder-3d371d03-e57a-4c4d-beff-780c737ed372-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:20 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] Delete snapshot completed successfully. Sep 23 15:23:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-60695db4-a6bb-469f-a284-64e4d3f5a7d5 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "cinder-970962b3-9bf7-47b1-9417-6a8cd383b72a-delete_snapshot" released by "delete_snapshot" :: held 1.844s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-dbafc05e-0dcf-4ad4-b0f2-4562215a75f4 tempest-VolumesSnapshotListTestJSON-1746937130 None] Acquiring lock "cinder-cfc4fc4a-67ca-4e65-8f2a-665330813f14-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-dbafc05e-0dcf-4ad4-b0f2-4562215a75f4 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "cinder-cfc4fc4a-67ca-4e65-8f2a-665330813f14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-dbafc05e-0dcf-4ad4-b0f2-4562215a75f4 tempest-VolumesSnapshotListTestJSON-1746937130 None] Acquiring lock "cinder-quobyte-4f44c05d-a5c0-475c-8b35-43873d56055a" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-dbafc05e-0dcf-4ad4-b0f2-4562215a75f4 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "cinder-quobyte-4f44c05d-a5c0-475c-8b35-43873d56055a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-dbafc05e-0dcf-4ad4-b0f2-4562215a75f4 tempest-VolumesSnapshotListTestJSON-1746937130 None] Acquiring lock "cinder-quobyte-cfc4fc4a-67ca-4e65-8f2a-665330813f14" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-dbafc05e-0dcf-4ad4-b0f2-4562215a75f4 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "cinder-quobyte-cfc4fc4a-67ca-4e65-8f2a-665330813f14" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-dbafc05e-0dcf-4ad4-b0f2-4562215a75f4 tempest-VolumesSnapshotListTestJSON-1746937130 None] Deleting offline snapshot cfc4fc4a-67ca-4e65-8f2a-665330813f14 of volume 4f44c05d-a5c0-475c-8b35-43873d56055a {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:23:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-dbafc05e-0dcf-4ad4-b0f2-4562215a75f4 tempest-VolumesSnapshotListTestJSON-1746937130 None] snapshot_file for this snap is: volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:23:20 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd97d7a-661a-4033-aa54-fb0563359a1a]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dbafc05e-0dcf-4ad4-b0f2-4562215a75f4 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:20 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14 Sep 23 15:23:20 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:21 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dbafc05e-0dcf-4ad4-b0f2-4562215a75f4 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14" returned: 0 in 0.396s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-dbafc05e-0dcf-4ad4-b0f2-4562215a75f4 tempest-VolumesSnapshotListTestJSON-1746937130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f44c05d-a5c0-475c-8b35-43873d56055a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:23:21 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f13c62-6cda-4964-9c01-8e288546512e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dbafc05e-0dcf-4ad4-b0f2-4562215a75f4 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:21 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a Sep 23 15:23:21 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:21 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dbafc05e-0dcf-4ad4-b0f2-4562215a75f4 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a" returned: 0 in 0.432s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dbafc05e-0dcf-4ad4-b0f2-4562215a75f4 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:21 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14 Sep 23 15:23:21 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:21 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dbafc05e-0dcf-4ad4-b0f2-4562215a75f4 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14" returned: 0 in 0.363s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dbafc05e-0dcf-4ad4-b0f2-4562215a75f4 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:21 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14 Sep 23 15:23:21 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:22 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dbafc05e-0dcf-4ad4-b0f2-4562215a75f4 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a.cfc4fc4a-67ca-4e65-8f2a-665330813f14" returned: 0 in 0.314s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:22 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=107,cinder:UPDATE=128,cinder:INSERT=39,cinder:DELETE=12 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:23:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-dbafc05e-0dcf-4ad4-b0f2-4562215a75f4 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "cinder-quobyte-cfc4fc4a-67ca-4e65-8f2a-665330813f14" released by "_delete_snapshot" :: held 1.656s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-dbafc05e-0dcf-4ad4-b0f2-4562215a75f4 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "cinder-quobyte-4f44c05d-a5c0-475c-8b35-43873d56055a" released by "delete_snapshot" :: held 1.683s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:22 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-dbafc05e-0dcf-4ad4-b0f2-4562215a75f4 tempest-VolumesSnapshotListTestJSON-1746937130 None] Created reservations ['d354cb89-d925-4df8-ac6d-5cb47eeb6387', 'cf6d9970-7d0d-4d92-ad68-914564e8d076', '2deb4fd7-b4ca-4337-bc2d-c8d098adf5d5', 'd502c7b1-c843-4c43-a934-5007cae2e22d'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:23:22 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-dbafc05e-0dcf-4ad4-b0f2-4562215a75f4 tempest-VolumesSnapshotListTestJSON-1746937130 None] Delete snapshot completed successfully. Sep 23 15:23:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-dbafc05e-0dcf-4ad4-b0f2-4562215a75f4 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "cinder-cfc4fc4a-67ca-4e65-8f2a-665330813f14-delete_snapshot" released by "delete_snapshot" :: held 1.869s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c5c474ab-1f49-4e78-b29f-12399b02ec24 tempest-VolumesSnapshotListTestJSON-1746937130 None] Acquiring lock "cinder-4f44c05d-a5c0-475c-8b35-43873d56055a-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c5c474ab-1f49-4e78-b29f-12399b02ec24 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "cinder-4f44c05d-a5c0-475c-8b35-43873d56055a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c5c474ab-1f49-4e78-b29f-12399b02ec24 tempest-VolumesSnapshotListTestJSON-1746937130 None] Acquiring lock "cinder-quobyte-4f44c05d-a5c0-475c-8b35-43873d56055a" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c5c474ab-1f49-4e78-b29f-12399b02ec24 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "cinder-quobyte-4f44c05d-a5c0-475c-8b35-43873d56055a" acquired by "delete_volume" :: waited 0.015s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:22 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[32441684-77af-4cd8-9d39-984a0f3d91dc]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c5c474ab-1f49-4e78-b29f-12399b02ec24 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:23 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a Sep 23 15:23:23 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:23 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c5c474ab-1f49-4e78-b29f-12399b02ec24 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a" returned: 0 in 0.407s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c5c474ab-1f49-4e78-b29f-12399b02ec24 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:23 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a Sep 23 15:23:23 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:23 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c5c474ab-1f49-4e78-b29f-12399b02ec24 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-4f44c05d-a5c0-475c-8b35-43873d56055a" returned: 0 in 0.294s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c5c474ab-1f49-4e78-b29f-12399b02ec24 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "cinder-quobyte-4f44c05d-a5c0-475c-8b35-43873d56055a" released by "delete_volume" :: held 0.782s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:23 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-c5c474ab-1f49-4e78-b29f-12399b02ec24 tempest-VolumesSnapshotListTestJSON-1746937130 None] Created reservations ['d48a74f8-500d-4a7e-a5b0-3d8323ec5eff', '9d1acd04-3c11-4498-a872-eee6ab88a892', '2c73ce11-bd84-4f73-9cbe-41e37de584ba', '3397731e-8c94-408e-ba10-e908a94846f6'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:23:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c5c474ab-1f49-4e78-b29f-12399b02ec24 tempest-VolumesSnapshotListTestJSON-1746937130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c5c474ab-1f49-4e78-b29f-12399b02ec24 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:23 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c5c474ab-1f49-4e78-b29f-12399b02ec24 tempest-VolumesSnapshotListTestJSON-1746937130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:23:23 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c5c474ab-1f49-4e78-b29f-12399b02ec24 tempest-VolumesSnapshotListTestJSON-1746937130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:23:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c5c474ab-1f49-4e78-b29f-12399b02ec24 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c5c474ab-1f49-4e78-b29f-12399b02ec24 tempest-VolumesSnapshotListTestJSON-1746937130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:23 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:23:23 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:24 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c5c474ab-1f49-4e78-b29f-12399b02ec24 tempest-VolumesSnapshotListTestJSON-1746937130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.287s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:24 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-c5c474ab-1f49-4e78-b29f-12399b02ec24 tempest-VolumesSnapshotListTestJSON-1746937130 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:23:24 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-c5c474ab-1f49-4e78-b29f-12399b02ec24 tempest-VolumesSnapshotListTestJSON-1746937130 None] Deleted volume successfully. Sep 23 15:23:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c5c474ab-1f49-4e78-b29f-12399b02ec24 tempest-VolumesSnapshotListTestJSON-1746937130 None] Lock "cinder-4f44c05d-a5c0-475c-8b35-43873d56055a-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Flow 'volume_create_manager' (2226daf4-626b-4c97-a43d-c0ee82b0b488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772ccb09-f28a-4327-b6ce-9551118e5915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772ccb09-f28a-4327-b6ce-9551118e5915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1526499369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bb94dee-7410-49f2-bd9b-4e3747a9c943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d071a3f9d214fa19534ce681441db27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:23:25Z,use_quota=True,user_id='ee05f7d035284cb4973f958852fecd79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de3f802-dde7-4434-8959-a57e1f0f3d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de3f802-dde7-4434-8959-a57e1f0f3d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d250955c-49fa-42a7-89ac-88a04371335c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d250955c-49fa-42a7-89ac-88a04371335c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bb94dee-7410-49f2-bd9b-4e3747a9c943', 'volume_name': 'volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047edc83-1663-46c8-8bba-218218f2eed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047edc83-1663-46c8-8bba-218218f2eed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc60329-ea82-431a-8787-828737f8f867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:25 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Volume 2bb94dee-7410-49f2-bd9b-4e3747a9c943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943', 'volume_size': 1} Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1526499369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bb94dee-7410-49f2-bd9b-4e3747a9c943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d071a3f9d214fa19534ce681441db27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:23:25Z,use_quota=True,user_id='ee05f7d035284cb4973f958852fecd79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Creating volume 2bb94dee-7410-49f2-bd9b-4e3747a9c943 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:23:25 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:25 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943 1073741824 Sep 23 15:23:25 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:25 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943 1073741824" returned: 0 in 0.479s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:25 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943 Sep 23 15:23:25 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:26 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943" returned: 0 in 0.297s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:23:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc60329-ea82-431a-8787-828737f8f867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39c35167-fed1-4c97-b7dc-ac209d0a2807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:26 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Volume volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943 (2bb94dee-7410-49f2-bd9b-4e3747a9c943): created successfully Sep 23 15:23:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39c35167-fed1-4c97-b7dc-ac209d0a2807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Flow 'volume_create_manager' (2226daf4-626b-4c97-a43d-c0ee82b0b488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:23:26 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-ab6c5ab4-79d3-470b-8594-6227c6e9998d tempest-CreateVolumesFromSnapshotTest-556594712 None] Created volume successfully. Sep 23 15:23:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b43f21a5-054c-4333-bc71-c7ae655554af tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b43f21a5-054c-4333-bc71-c7ae655554af tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:27 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-b43f21a5-054c-4333-bc71-c7ae655554af tempest-CreateVolumesFromSnapshotTest-556594712 None] Creating offline snapshot 235d706c-d7f0-4ef0-82ac-ca55a191f5ae of volume 2bb94dee-7410-49f2-bd9b-4e3747a9c943 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:23:27 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[19147eb0-4f7c-4a17-9f73-c3336192c7ac]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b43f21a5-054c-4333-bc71-c7ae655554af tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:27 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943 Sep 23 15:23:27 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:27 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b43f21a5-054c-4333-bc71-c7ae655554af tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943" returned: 0 in 0.403s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b43f21a5-054c-4333-bc71-c7ae655554af tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.235d706c-d7f0-4ef0-82ac-ca55a191f5ae 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:27 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.235d706c-d7f0-4ef0-82ac-ca55a191f5ae 1G Sep 23 15:23:27 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:28 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b43f21a5-054c-4333-bc71-c7ae655554af tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.235d706c-d7f0-4ef0-82ac-ca55a191f5ae 1G" returned: 0 in 0.442s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b43f21a5-054c-4333-bc71-c7ae655554af tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.235d706c-d7f0-4ef0-82ac-ca55a191f5ae {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:28 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.235d706c-d7f0-4ef0-82ac-ca55a191f5ae Sep 23 15:23:28 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:28 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b43f21a5-054c-4333-bc71-c7ae655554af tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.235d706c-d7f0-4ef0-82ac-ca55a191f5ae" returned: 0 in 0.318s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:28 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-b43f21a5-054c-4333-bc71-c7ae655554af tempest-CreateVolumesFromSnapshotTest-556594712 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.235d706c-d7f0-4ef0-82ac-ca55a191f5ae is being set with open permissions: ugo+rw Sep 23 15:23:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b43f21a5-054c-4333-bc71-c7ae655554af tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.235d706c-d7f0-4ef0-82ac-ca55a191f5ae {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:28 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.235d706c-d7f0-4ef0-82ac-ca55a191f5ae Sep 23 15:23:28 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:29 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b43f21a5-054c-4333-bc71-c7ae655554af tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.235d706c-d7f0-4ef0-82ac-ca55a191f5ae" returned: 0 in 0.281s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:29 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=108,cinder:UPDATE=117,cinder:INSERT=43,cinder:DELETE=6 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:23:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b43f21a5-054c-4333-bc71-c7ae655554af tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:29 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.info Sep 23 15:23:29 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:29 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b43f21a5-054c-4333-bc71-c7ae655554af tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.info" returned: 0 in 0.277s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:29 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-b43f21a5-054c-4333-bc71-c7ae655554af tempest-CreateVolumesFromSnapshotTest-556594712 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.info is being set with open permissions: ugo+rw Sep 23 15:23:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b43f21a5-054c-4333-bc71-c7ae655554af tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:29 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.info Sep 23 15:23:29 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:29 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b43f21a5-054c-4333-bc71-c7ae655554af tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.info" returned: 0 in 0.262s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b43f21a5-054c-4333-bc71-c7ae655554af tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:29 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-b43f21a5-054c-4333-bc71-c7ae655554af tempest-CreateVolumesFromSnapshotTest-556594712 None] Create snapshot completed successfully Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Flow 'volume_create_manager' (94e0131f-c7e7-4d2d-9374-8d3b179507da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a41e88-d1e6-44c9-b660-24bc8c78ebbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a41e88-d1e6-44c9-b660-24bc8c78ebbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1624079917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce217948-c8d1-482c-b3ab-0aa1b97a24f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d071a3f9d214fa19534ce681441db27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:23:31Z,use_quota=True,user_id='ee05f7d035284cb4973f958852fecd79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (969cb2cb-8eb2-4f9e-b2c8-ea83432b265e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (969cb2cb-8eb2-4f9e-b2c8-ea83432b265e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699704c1-3996-4f8b-8b89-e132fab9b8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699704c1-3996-4f8b-8b89-e132fab9b8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce217948-c8d1-482c-b3ab-0aa1b97a24f6', 'volume_name': 'volume-ce217948-c8d1-482c-b3ab-0aa1b97a24f6', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9228a632-08aa-4b81-9846-73d87e41e270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9228a632-08aa-4b81-9846-73d87e41e270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e685fa81-cb63-4fb7-b968-ee09cd35972a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:31 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Volume ce217948-c8d1-482c-b3ab-0aa1b97a24f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce217948-c8d1-482c-b3ab-0aa1b97a24f6', 'volume_size': 1} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1624079917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce217948-c8d1-482c-b3ab-0aa1b97a24f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d071a3f9d214fa19534ce681441db27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:23:31Z,use_quota=True,user_id='ee05f7d035284cb4973f958852fecd79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Creating volume ce217948-c8d1-482c-b3ab-0aa1b97a24f6 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:23:31 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce217948-c8d1-482c-b3ab-0aa1b97a24f6 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:31 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce217948-c8d1-482c-b3ab-0aa1b97a24f6 1073741824 Sep 23 15:23:31 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Flow 'volume_create_manager' (4adfee16-b29c-4803-ab3f-5f20305a955c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c08c87e-985c-49cb-a1f6-84782dfd709a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c08c87e-985c-49cb-a1f6-84782dfd709a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-346164659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47cddafd-7119-4e17-85b9-f3f018031970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d071a3f9d214fa19534ce681441db27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:23:32Z,use_quota=True,user_id='ee05f7d035284cb4973f958852fecd79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd533c25-e3c0-40e9-a6c4-0069451df24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd533c25-e3c0-40e9-a6c4-0069451df24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a6f439-2659-4690-80ce-cbe63f01ce2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a6f439-2659-4690-80ce-cbe63f01ce2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47cddafd-7119-4e17-85b9-f3f018031970', 'volume_name': 'volume-47cddafd-7119-4e17-85b9-f3f018031970', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (596b6f6c-1eab-4fb0-8fa0-54867d367cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (596b6f6c-1eab-4fb0-8fa0-54867d367cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c006c6d4-5d89-4813-b3c1-da6c3fbc619b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:32 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Volume 47cddafd-7119-4e17-85b9-f3f018031970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47cddafd-7119-4e17-85b9-f3f018031970', 'volume_size': 1} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:32 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce217948-c8d1-482c-b3ab-0aa1b97a24f6 1073741824" returned: 0 in 0.693s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce217948-c8d1-482c-b3ab-0aa1b97a24f6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:32 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce217948-c8d1-482c-b3ab-0aa1b97a24f6 Sep 23 15:23:32 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:32 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce217948-c8d1-482c-b3ab-0aa1b97a24f6" returned: 0 in 0.353s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.440s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-346164659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47cddafd-7119-4e17-85b9-f3f018031970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d071a3f9d214fa19534ce681441db27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:23:32Z,use_quota=True,user_id='ee05f7d035284cb4973f958852fecd79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Creating volume 47cddafd-7119-4e17-85b9-f3f018031970 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:23:32 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-47cddafd-7119-4e17-85b9-f3f018031970 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:32 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-47cddafd-7119-4e17-85b9-f3f018031970 1073741824 Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e685fa81-cb63-4fb7-b968-ee09cd35972a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce217948-c8d1-482c-b3ab-0aa1b97a24f6', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:32 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c131d0-511c-4997-9306-fe50134bdc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:32 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Volume volume-ce217948-c8d1-482c-b3ab-0aa1b97a24f6 (ce217948-c8d1-482c-b3ab-0aa1b97a24f6): created successfully Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c131d0-511c-4997-9306-fe50134bdc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Flow 'volume_create_manager' (94e0131f-c7e7-4d2d-9374-8d3b179507da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Flow 'volume_create_manager' (988b086c-68d5-49ad-8106-00a0eaf9c221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830aba34-f065-49c3-ae09-ab1f5d2b044b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:32 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-42b38e1d-5add-4e93-bbbe-47f934fabc8d tempest-CreateVolumesFromSnapshotTest-556594712 None] Created volume successfully. Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830aba34-f065-49c3-ae09-ab1f5d2b044b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1479615822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d071a3f9d214fa19534ce681441db27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:23:32Z,use_quota=True,user_id='ee05f7d035284cb4973f958852fecd79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9ae2ff-78d8-4a22-a7dc-10af48011342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9ae2ff-78d8-4a22-a7dc-10af48011342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ad3e6b-62a2-4901-b43c-d4fac5037d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ad3e6b-62a2-4901-b43c-d4fac5037d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8', 'volume_name': 'volume-11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b12108-ff0f-4a7e-8af3-b928b01578ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b12108-ff0f-4a7e-8af3-b928b01578ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26127ef8-9123-4ecc-ac0f-de0847be3c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:32 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Volume 11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8', 'volume_size': 1} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:23:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Flow 'volume_create_manager' (3d9ff5d0-764c-4e29-a732-81fe869f441c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a4dcbfe-2951-4bf0-a03d-51d0c9584cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a4dcbfe-2951-4bf0-a03d-51d0c9584cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1641547909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c2a5a31-a0fc-4499-bbab-31927ddf524b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d071a3f9d214fa19534ce681441db27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:23:33Z,use_quota=True,user_id='ee05f7d035284cb4973f958852fecd79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83eae030-8b9e-4773-b3fd-9936eea43aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83eae030-8b9e-4773-b3fd-9936eea43aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7990d02-4df5-45c6-8cdb-b8b52a6cf41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7990d02-4df5-45c6-8cdb-b8b52a6cf41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c2a5a31-a0fc-4499-bbab-31927ddf524b', 'volume_name': 'volume-3c2a5a31-a0fc-4499-bbab-31927ddf524b', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae68a611-7c4c-43fc-9b0e-7045206b6522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae68a611-7c4c-43fc-9b0e-7045206b6522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (407cfbf9-9661-4f02-b363-e10de3fe9fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:33 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Volume 3c2a5a31-a0fc-4499-bbab-31927ddf524b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c2a5a31-a0fc-4499-bbab-31927ddf524b', 'volume_size': 1} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:33 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-47cddafd-7119-4e17-85b9-f3f018031970 1073741824" returned: 0 in 0.704s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-47cddafd-7119-4e17-85b9-f3f018031970 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:33 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-47cddafd-7119-4e17-85b9-f3f018031970 Sep 23 15:23:33 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:33 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-47cddafd-7119-4e17-85b9-f3f018031970" returned: 0 in 0.285s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.791s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1479615822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d071a3f9d214fa19534ce681441db27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:23:32Z,use_quota=True,user_id='ee05f7d035284cb4973f958852fecd79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Creating volume 11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:23:33 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:33 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8 1073741824 Sep 23 15:23:33 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c006c6d4-5d89-4813-b3c1-da6c3fbc619b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47cddafd-7119-4e17-85b9-f3f018031970', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97eb95c2-dd6d-4148-b8b9-d2b10961ad00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Flow 'volume_create_manager' (2cb9a759-09ed-4029-8e0f-ca0ae3c8758a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85c4216-e951-4c3a-8cd9-1babd90e22fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85c4216-e951-4c3a-8cd9-1babd90e22fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-490451960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f100b28-a170-4783-b094-0e490f981156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d071a3f9d214fa19534ce681441db27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:23:33Z,use_quota=True,user_id='ee05f7d035284cb4973f958852fecd79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed19022-8323-4545-a323-a267b767907f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed19022-8323-4545-a323-a267b767907f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f7865f-7a2a-419a-816d-8b99853052b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f7865f-7a2a-419a-816d-8b99853052b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f100b28-a170-4783-b094-0e490f981156', 'volume_name': 'volume-9f100b28-a170-4783-b094-0e490f981156', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7dfcb0-99f3-466d-b2c1-882575e86a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7dfcb0-99f3-466d-b2c1-882575e86a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84730a7-adf0-4d74-9184-aa702e4fde23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:33 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Volume 9f100b28-a170-4783-b094-0e490f981156: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f100b28-a170-4783-b094-0e490f981156', 'volume_size': 1} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:33 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Volume volume-47cddafd-7119-4e17-85b9-f3f018031970 (47cddafd-7119-4e17-85b9-f3f018031970): created successfully Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97eb95c2-dd6d-4148-b8b9-d2b10961ad00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Flow 'volume_create_manager' (4adfee16-b29c-4803-ab3f-5f20305a955c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:23:33 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-bb319efe-9a45-433f-a589-ebc6f22bd4d4 tempest-CreateVolumesFromSnapshotTest-556594712 None] Created volume successfully. Sep 23 15:23:34 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8 1073741824" returned: 0 in 0.519s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:34 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8 Sep 23 15:23:34 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:34 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8" returned: 0 in 0.271s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:23:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.264s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1641547909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c2a5a31-a0fc-4499-bbab-31927ddf524b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d071a3f9d214fa19534ce681441db27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:23:33Z,use_quota=True,user_id='ee05f7d035284cb4973f958852fecd79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:23:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Creating volume 3c2a5a31-a0fc-4499-bbab-31927ddf524b {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:23:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:23:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:23:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:23:34 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:23:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3c2a5a31-a0fc-4499-bbab-31927ddf524b 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:34 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3c2a5a31-a0fc-4499-bbab-31927ddf524b 1073741824 Sep 23 15:23:34 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26127ef8-9123-4ecc-ac0f-de0847be3c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c13b8dc-1e4e-4529-bd1e-d14704e98e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:34 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Volume volume-11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8 (11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8): created successfully Sep 23 15:23:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c13b8dc-1e4e-4529-bd1e-d14704e98e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Flow 'volume_create_manager' (988b086c-68d5-49ad-8106-00a0eaf9c221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:23:34 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-2b1bfdf3-7776-4d35-be30-6ffd179edd45 tempest-CreateVolumesFromSnapshotTest-556594712 None] Created volume successfully. Sep 23 15:23:34 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3c2a5a31-a0fc-4499-bbab-31927ddf524b 1073741824" returned: 0 in 0.570s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3c2a5a31-a0fc-4499-bbab-31927ddf524b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:35 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3c2a5a31-a0fc-4499-bbab-31927ddf524b Sep 23 15:23:35 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:35 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3c2a5a31-a0fc-4499-bbab-31927ddf524b" returned: 0 in 0.260s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:23:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.593s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-490451960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f100b28-a170-4783-b094-0e490f981156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d071a3f9d214fa19534ce681441db27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:23:33Z,use_quota=True,user_id='ee05f7d035284cb4973f958852fecd79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:23:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Creating volume 9f100b28-a170-4783-b094-0e490f981156 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:23:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:23:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:23:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:23:35 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:23:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9f100b28-a170-4783-b094-0e490f981156 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (407cfbf9-9661-4f02-b363-e10de3fe9fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c2a5a31-a0fc-4499-bbab-31927ddf524b', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861b3b13-cc6e-49b6-a329-e182f4998aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:35 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9f100b28-a170-4783-b094-0e490f981156 1073741824 Sep 23 15:23:35 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:35 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Volume volume-3c2a5a31-a0fc-4499-bbab-31927ddf524b (3c2a5a31-a0fc-4499-bbab-31927ddf524b): created successfully Sep 23 15:23:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861b3b13-cc6e-49b6-a329-e182f4998aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Flow 'volume_create_manager' (3d9ff5d0-764c-4e29-a732-81fe869f441c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:23:35 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-638ad45b-6526-40a8-b35d-3be1167d796c tempest-CreateVolumesFromSnapshotTest-556594712 None] Created volume successfully. Sep 23 15:23:35 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9f100b28-a170-4783-b094-0e490f981156 1073741824" returned: 0 in 0.487s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9f100b28-a170-4783-b094-0e490f981156 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:35 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9f100b28-a170-4783-b094-0e490f981156 Sep 23 15:23:35 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:36 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9f100b28-a170-4783-b094-0e490f981156" returned: 0 in 0.270s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:23:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84730a7-adf0-4d74-9184-aa702e4fde23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f100b28-a170-4783-b094-0e490f981156', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4ab4fb-602d-4e93-b9b2-fd1e96a78dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:36 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Volume volume-9f100b28-a170-4783-b094-0e490f981156 (9f100b28-a170-4783-b094-0e490f981156): created successfully Sep 23 15:23:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4ab4fb-602d-4e93-b9b2-fd1e96a78dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Flow 'volume_create_manager' (2cb9a759-09ed-4029-8e0f-ca0ae3c8758a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:23:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:23:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:23:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:23:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:36 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-d8755463-1073-46a6-820b-d034e34d6462 tempest-CreateVolumesFromSnapshotTest-556594712 None] Created volume successfully. Sep 23 15:23:36 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:23:36 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:36 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.298s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:23:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:23:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 28 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:23:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:23:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e0a3c7e4-ad65-4f83-812e-0a62c8a89b63 tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "cinder-9f100b28-a170-4783-b094-0e490f981156-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e0a3c7e4-ad65-4f83-812e-0a62c8a89b63 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-9f100b28-a170-4783-b094-0e490f981156-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e0a3c7e4-ad65-4f83-812e-0a62c8a89b63 tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "cinder-quobyte-9f100b28-a170-4783-b094-0e490f981156" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e0a3c7e4-ad65-4f83-812e-0a62c8a89b63 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-quobyte-9f100b28-a170-4783-b094-0e490f981156" acquired by "delete_volume" :: waited 0.027s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:37 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3580fbbe-a85e-448e-8f5f-c512d9de9b1b]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e0a3c7e4-ad65-4f83-812e-0a62c8a89b63 tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9f100b28-a170-4783-b094-0e490f981156 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:37 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9f100b28-a170-4783-b094-0e490f981156 Sep 23 15:23:37 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:37 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e0a3c7e4-ad65-4f83-812e-0a62c8a89b63 tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9f100b28-a170-4783-b094-0e490f981156" returned: 0 in 0.470s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e0a3c7e4-ad65-4f83-812e-0a62c8a89b63 tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9f100b28-a170-4783-b094-0e490f981156 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:37 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9f100b28-a170-4783-b094-0e490f981156 Sep 23 15:23:37 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:37 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e0a3c7e4-ad65-4f83-812e-0a62c8a89b63 tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-9f100b28-a170-4783-b094-0e490f981156" returned: 0 in 0.280s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e0a3c7e4-ad65-4f83-812e-0a62c8a89b63 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-quobyte-9f100b28-a170-4783-b094-0e490f981156" released by "delete_volume" :: held 0.837s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:37 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-e0a3c7e4-ad65-4f83-812e-0a62c8a89b63 tempest-CreateVolumesFromSnapshotTest-556594712 None] Created reservations ['fa9b9d22-2f00-413f-ba88-da7fbaa5c4da', 'a75afbbe-dca3-4649-adb5-dce7788dcf1e', 'ed85faa5-8076-450a-82cb-bc93e6e67845', '3f2981ab-6306-4978-9a40-9df1b90a733c'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:23:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e0a3c7e4-ad65-4f83-812e-0a62c8a89b63 tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e0a3c7e4-ad65-4f83-812e-0a62c8a89b63 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e0a3c7e4-ad65-4f83-812e-0a62c8a89b63 tempest-CreateVolumesFromSnapshotTest-556594712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:23:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e0a3c7e4-ad65-4f83-812e-0a62c8a89b63 tempest-CreateVolumesFromSnapshotTest-556594712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:23:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e0a3c7e4-ad65-4f83-812e-0a62c8a89b63 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e0a3c7e4-ad65-4f83-812e-0a62c8a89b63 tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:38 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:23:38 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-30ee2c74-4ffd-4711-9805-e20af44e9aa0 tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "cinder-3c2a5a31-a0fc-4499-bbab-31927ddf524b-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-30ee2c74-4ffd-4711-9805-e20af44e9aa0 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-3c2a5a31-a0fc-4499-bbab-31927ddf524b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-30ee2c74-4ffd-4711-9805-e20af44e9aa0 tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "cinder-quobyte-3c2a5a31-a0fc-4499-bbab-31927ddf524b" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-30ee2c74-4ffd-4711-9805-e20af44e9aa0 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-quobyte-3c2a5a31-a0fc-4499-bbab-31927ddf524b" acquired by "delete_volume" :: waited 0.016s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:38 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e6af8d-355c-41d0-aa23-afa099582121]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-30ee2c74-4ffd-4711-9805-e20af44e9aa0 tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3c2a5a31-a0fc-4499-bbab-31927ddf524b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:38 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e0a3c7e4-ad65-4f83-812e-0a62c8a89b63 tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.310s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:38 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-e0a3c7e4-ad65-4f83-812e-0a62c8a89b63 tempest-CreateVolumesFromSnapshotTest-556594712 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:23:38 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-e0a3c7e4-ad65-4f83-812e-0a62c8a89b63 tempest-CreateVolumesFromSnapshotTest-556594712 None] Deleted volume successfully. Sep 23 15:23:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e0a3c7e4-ad65-4f83-812e-0a62c8a89b63 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-9f100b28-a170-4783-b094-0e490f981156-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:38 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3c2a5a31-a0fc-4499-bbab-31927ddf524b Sep 23 15:23:38 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:38 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-30ee2c74-4ffd-4711-9805-e20af44e9aa0 tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3c2a5a31-a0fc-4499-bbab-31927ddf524b" returned: 0 in 0.432s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-30ee2c74-4ffd-4711-9805-e20af44e9aa0 tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3c2a5a31-a0fc-4499-bbab-31927ddf524b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:38 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3c2a5a31-a0fc-4499-bbab-31927ddf524b Sep 23 15:23:38 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:38 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-30ee2c74-4ffd-4711-9805-e20af44e9aa0 tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3c2a5a31-a0fc-4499-bbab-31927ddf524b" returned: 0 in 0.263s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-30ee2c74-4ffd-4711-9805-e20af44e9aa0 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-quobyte-3c2a5a31-a0fc-4499-bbab-31927ddf524b" released by "delete_volume" :: held 0.743s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:39 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-30ee2c74-4ffd-4711-9805-e20af44e9aa0 tempest-CreateVolumesFromSnapshotTest-556594712 None] Created reservations ['fabd8789-ccd6-4eac-b13a-cfb0678a9b28', '2357a092-2473-4925-a613-89e4d24cb301', '672c1802-8f15-498b-9114-60c3e8549095', '50161ec6-21ee-45ff-bd56-c0934b016b7a'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:23:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-30ee2c74-4ffd-4711-9805-e20af44e9aa0 tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-30ee2c74-4ffd-4711-9805-e20af44e9aa0 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-30ee2c74-4ffd-4711-9805-e20af44e9aa0 tempest-CreateVolumesFromSnapshotTest-556594712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:23:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-30ee2c74-4ffd-4711-9805-e20af44e9aa0 tempest-CreateVolumesFromSnapshotTest-556594712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:23:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-30ee2c74-4ffd-4711-9805-e20af44e9aa0 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-30ee2c74-4ffd-4711-9805-e20af44e9aa0 tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:39 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:23:39 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-86d2a844-3352-4323-aded-5b69f8e4e09d tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "cinder-11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-86d2a844-3352-4323-aded-5b69f8e4e09d tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:39 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-30ee2c74-4ffd-4711-9805-e20af44e9aa0 tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.356s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:39 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-30ee2c74-4ffd-4711-9805-e20af44e9aa0 tempest-CreateVolumesFromSnapshotTest-556594712 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:23:39 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-30ee2c74-4ffd-4711-9805-e20af44e9aa0 tempest-CreateVolumesFromSnapshotTest-556594712 None] Deleted volume successfully. Sep 23 15:23:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-86d2a844-3352-4323-aded-5b69f8e4e09d tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "cinder-quobyte-11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-30ee2c74-4ffd-4711-9805-e20af44e9aa0 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-3c2a5a31-a0fc-4499-bbab-31927ddf524b-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-86d2a844-3352-4323-aded-5b69f8e4e09d tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-quobyte-11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8" acquired by "delete_volume" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:39 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[84060475-0745-49e5-a946-911fac191201]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-86d2a844-3352-4323-aded-5b69f8e4e09d tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:39 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8 Sep 23 15:23:39 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:39 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-86d2a844-3352-4323-aded-5b69f8e4e09d tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8" returned: 0 in 0.400s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-86d2a844-3352-4323-aded-5b69f8e4e09d tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:39 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8 Sep 23 15:23:39 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:40 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-86d2a844-3352-4323-aded-5b69f8e4e09d tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8" returned: 0 in 0.268s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:40 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-86d2a844-3352-4323-aded-5b69f8e4e09d tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-quobyte-11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8" released by "delete_volume" :: held 0.720s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:40 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-86d2a844-3352-4323-aded-5b69f8e4e09d tempest-CreateVolumesFromSnapshotTest-556594712 None] Created reservations ['fd690815-6d3b-40de-b5ef-0ee5774965a2', 'ac4a2114-2a58-4278-a307-58ad1a1a6564', '6ababe1a-132c-44a6-aa6d-d176b8518da7', '19f5ac22-0efb-4a01-b5b1-466254249c0c'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:23:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-86d2a844-3352-4323-aded-5b69f8e4e09d tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-86d2a844-3352-4323-aded-5b69f8e4e09d tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:40 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-86d2a844-3352-4323-aded-5b69f8e4e09d tempest-CreateVolumesFromSnapshotTest-556594712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:23:40 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-86d2a844-3352-4323-aded-5b69f8e4e09d tempest-CreateVolumesFromSnapshotTest-556594712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:23:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-86d2a844-3352-4323-aded-5b69f8e4e09d tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-86d2a844-3352-4323-aded-5b69f8e4e09d tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:40 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:23:40 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:40 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-65ea32bd-070e-425d-877b-d3ba216f0a68 tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "cinder-47cddafd-7119-4e17-85b9-f3f018031970-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:40 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-65ea32bd-070e-425d-877b-d3ba216f0a68 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-47cddafd-7119-4e17-85b9-f3f018031970-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:40 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-86d2a844-3352-4323-aded-5b69f8e4e09d tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.304s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:40 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-86d2a844-3352-4323-aded-5b69f8e4e09d tempest-CreateVolumesFromSnapshotTest-556594712 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:23:40 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-86d2a844-3352-4323-aded-5b69f8e4e09d tempest-CreateVolumesFromSnapshotTest-556594712 None] Deleted volume successfully. Sep 23 15:23:40 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-65ea32bd-070e-425d-877b-d3ba216f0a68 tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "cinder-quobyte-47cddafd-7119-4e17-85b9-f3f018031970" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:40 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-86d2a844-3352-4323-aded-5b69f8e4e09d tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-11a3b46e-8bc6-4d43-ae5c-9d946c77a5e8-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:40 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-65ea32bd-070e-425d-877b-d3ba216f0a68 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-quobyte-47cddafd-7119-4e17-85b9-f3f018031970" acquired by "delete_volume" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:40 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0ba1fa-f5bb-409a-9d74-2879f2d0017e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-65ea32bd-070e-425d-877b-d3ba216f0a68 tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-47cddafd-7119-4e17-85b9-f3f018031970 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:40 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-47cddafd-7119-4e17-85b9-f3f018031970 Sep 23 15:23:40 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:41 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-65ea32bd-070e-425d-877b-d3ba216f0a68 tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-47cddafd-7119-4e17-85b9-f3f018031970" returned: 0 in 0.365s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-65ea32bd-070e-425d-877b-d3ba216f0a68 tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-47cddafd-7119-4e17-85b9-f3f018031970 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:41 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-47cddafd-7119-4e17-85b9-f3f018031970 Sep 23 15:23:41 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:41 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-65ea32bd-070e-425d-877b-d3ba216f0a68 tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-47cddafd-7119-4e17-85b9-f3f018031970" returned: 0 in 0.281s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-65ea32bd-070e-425d-877b-d3ba216f0a68 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-quobyte-47cddafd-7119-4e17-85b9-f3f018031970" released by "delete_volume" :: held 0.697s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:41 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-65ea32bd-070e-425d-877b-d3ba216f0a68 tempest-CreateVolumesFromSnapshotTest-556594712 None] Created reservations ['5cc039fb-5f0f-4260-b0a2-4458b7b0023b', 'aef3a48b-e5eb-4e9e-85e5-6846d6bafaec', '31eabe06-0239-4e2b-b7b1-d73e809df3be', '7efff5cb-6d90-4232-befc-e1b81ea29a6a'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:23:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-65ea32bd-070e-425d-877b-d3ba216f0a68 tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-65ea32bd-070e-425d-877b-d3ba216f0a68 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:41 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-65ea32bd-070e-425d-877b-d3ba216f0a68 tempest-CreateVolumesFromSnapshotTest-556594712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:23:41 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-65ea32bd-070e-425d-877b-d3ba216f0a68 tempest-CreateVolumesFromSnapshotTest-556594712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:23:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-65ea32bd-070e-425d-877b-d3ba216f0a68 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-65ea32bd-070e-425d-877b-d3ba216f0a68 tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:41 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:23:41 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c763042e-d88c-40c5-985b-196d1f040475 tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "cinder-ce217948-c8d1-482c-b3ab-0aa1b97a24f6-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:41 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-65ea32bd-070e-425d-877b-d3ba216f0a68 tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.283s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:41 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-65ea32bd-070e-425d-877b-d3ba216f0a68 tempest-CreateVolumesFromSnapshotTest-556594712 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:23:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c763042e-d88c-40c5-985b-196d1f040475 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-ce217948-c8d1-482c-b3ab-0aa1b97a24f6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:41 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-65ea32bd-070e-425d-877b-d3ba216f0a68 tempest-CreateVolumesFromSnapshotTest-556594712 None] Deleted volume successfully. Sep 23 15:23:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-65ea32bd-070e-425d-877b-d3ba216f0a68 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-47cddafd-7119-4e17-85b9-f3f018031970-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c763042e-d88c-40c5-985b-196d1f040475 tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "cinder-quobyte-ce217948-c8d1-482c-b3ab-0aa1b97a24f6" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c763042e-d88c-40c5-985b-196d1f040475 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-quobyte-ce217948-c8d1-482c-b3ab-0aa1b97a24f6" acquired by "delete_volume" :: waited 0.019s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:41 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea689edb-1ee4-418f-a559-e9474b335107]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c763042e-d88c-40c5-985b-196d1f040475 tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce217948-c8d1-482c-b3ab-0aa1b97a24f6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:42 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce217948-c8d1-482c-b3ab-0aa1b97a24f6 Sep 23 15:23:42 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:42 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c763042e-d88c-40c5-985b-196d1f040475 tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce217948-c8d1-482c-b3ab-0aa1b97a24f6" returned: 0 in 0.389s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c763042e-d88c-40c5-985b-196d1f040475 tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce217948-c8d1-482c-b3ab-0aa1b97a24f6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:42 devstack sudo[104407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce217948-c8d1-482c-b3ab-0aa1b97a24f6 Sep 23 15:23:42 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:42 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c763042e-d88c-40c5-985b-196d1f040475 tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ce217948-c8d1-482c-b3ab-0aa1b97a24f6" returned: 0 in 0.278s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:42 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c763042e-d88c-40c5-985b-196d1f040475 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-quobyte-ce217948-c8d1-482c-b3ab-0aa1b97a24f6" released by "delete_volume" :: held 0.723s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:42 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-c763042e-d88c-40c5-985b-196d1f040475 tempest-CreateVolumesFromSnapshotTest-556594712 None] Created reservations ['4bfdcfb2-1ce1-4f0c-a45e-1c60bbb1bb8f', '3e4195fe-578b-4b2b-8a19-7153f90dca8b', '942f020f-72c3-4a7b-b4c6-af32fc275a73', 'cd40b04b-3510-43fe-9f09-5dde68eb9edc'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:23:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c763042e-d88c-40c5-985b-196d1f040475 tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c763042e-d88c-40c5-985b-196d1f040475 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:42 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c763042e-d88c-40c5-985b-196d1f040475 tempest-CreateVolumesFromSnapshotTest-556594712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:23:42 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c763042e-d88c-40c5-985b-196d1f040475 tempest-CreateVolumesFromSnapshotTest-556594712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:23:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c763042e-d88c-40c5-985b-196d1f040475 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c763042e-d88c-40c5-985b-196d1f040475 tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:42 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:23:42 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5b6522e2-c455-4dd4-9109-8d0a4b617895 tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "cinder-235d706c-d7f0-4ef0-82ac-ca55a191f5ae-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:43 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5b6522e2-c455-4dd4-9109-8d0a4b617895 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-235d706c-d7f0-4ef0-82ac-ca55a191f5ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5b6522e2-c455-4dd4-9109-8d0a4b617895 tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "cinder-quobyte-2bb94dee-7410-49f2-bd9b-4e3747a9c943" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c763042e-d88c-40c5-985b-196d1f040475 tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.340s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:43 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-c763042e-d88c-40c5-985b-196d1f040475 tempest-CreateVolumesFromSnapshotTest-556594712 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:23:43 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-c763042e-d88c-40c5-985b-196d1f040475 tempest-CreateVolumesFromSnapshotTest-556594712 None] Deleted volume successfully. Sep 23 15:23:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5b6522e2-c455-4dd4-9109-8d0a4b617895 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-quobyte-2bb94dee-7410-49f2-bd9b-4e3747a9c943" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5b6522e2-c455-4dd4-9109-8d0a4b617895 tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "cinder-quobyte-235d706c-d7f0-4ef0-82ac-ca55a191f5ae" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c763042e-d88c-40c5-985b-196d1f040475 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-ce217948-c8d1-482c-b3ab-0aa1b97a24f6-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5b6522e2-c455-4dd4-9109-8d0a4b617895 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-quobyte-235d706c-d7f0-4ef0-82ac-ca55a191f5ae" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:43 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-5b6522e2-c455-4dd4-9109-8d0a4b617895 tempest-CreateVolumesFromSnapshotTest-556594712 None] Deleting offline snapshot 235d706c-d7f0-4ef0-82ac-ca55a191f5ae of volume 2bb94dee-7410-49f2-bd9b-4e3747a9c943 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:23:43 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-5b6522e2-c455-4dd4-9109-8d0a4b617895 tempest-CreateVolumesFromSnapshotTest-556594712 None] snapshot_file for this snap is: volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.235d706c-d7f0-4ef0-82ac-ca55a191f5ae {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:23:43 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[71711a5a-50c8-42f6-9fb1-2084fce792d3]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5b6522e2-c455-4dd4-9109-8d0a4b617895 tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.235d706c-d7f0-4ef0-82ac-ca55a191f5ae {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:43 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.235d706c-d7f0-4ef0-82ac-ca55a191f5ae Sep 23 15:23:43 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:43 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5b6522e2-c455-4dd4-9109-8d0a4b617895 tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.235d706c-d7f0-4ef0-82ac-ca55a191f5ae" returned: 0 in 0.394s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:43 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-5b6522e2-c455-4dd4-9109-8d0a4b617895 tempest-CreateVolumesFromSnapshotTest-556594712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:23:43 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8fd602-4f18-45aa-b5a2-3047fd5361f6]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5b6522e2-c455-4dd4-9109-8d0a4b617895 tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:43 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943 Sep 23 15:23:43 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:44 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5b6522e2-c455-4dd4-9109-8d0a4b617895 tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943" returned: 0 in 0.430s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5b6522e2-c455-4dd4-9109-8d0a4b617895 tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.235d706c-d7f0-4ef0-82ac-ca55a191f5ae {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:44 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.235d706c-d7f0-4ef0-82ac-ca55a191f5ae Sep 23 15:23:44 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:44 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5b6522e2-c455-4dd4-9109-8d0a4b617895 tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.235d706c-d7f0-4ef0-82ac-ca55a191f5ae" returned: 0 in 0.416s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5b6522e2-c455-4dd4-9109-8d0a4b617895 tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.235d706c-d7f0-4ef0-82ac-ca55a191f5ae {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:44 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.235d706c-d7f0-4ef0-82ac-ca55a191f5ae Sep 23 15:23:44 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:44 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5b6522e2-c455-4dd4-9109-8d0a4b617895 tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943.235d706c-d7f0-4ef0-82ac-ca55a191f5ae" returned: 0 in 0.293s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:44 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5b6522e2-c455-4dd4-9109-8d0a4b617895 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-quobyte-235d706c-d7f0-4ef0-82ac-ca55a191f5ae" released by "_delete_snapshot" :: held 1.688s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:44 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5b6522e2-c455-4dd4-9109-8d0a4b617895 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-quobyte-2bb94dee-7410-49f2-bd9b-4e3747a9c943" released by "delete_snapshot" :: held 1.722s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:44 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-5b6522e2-c455-4dd4-9109-8d0a4b617895 tempest-CreateVolumesFromSnapshotTest-556594712 None] Created reservations ['824cafc2-7c63-4461-913f-e456f29f11f3', '839cfae2-1849-467f-ab98-ba1cab1e2bff', '2f4e97a2-38f3-47df-885c-5837e8c275ff', '3aa66cb9-a453-47c7-83ac-192d92b3e8fb'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:23:45 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5b6522e2-c455-4dd4-9109-8d0a4b617895 tempest-CreateVolumesFromSnapshotTest-556594712 None] Delete snapshot completed successfully. Sep 23 15:23:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5b6522e2-c455-4dd4-9109-8d0a4b617895 tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-235d706c-d7f0-4ef0-82ac-ca55a191f5ae-delete_snapshot" released by "delete_snapshot" :: held 1.931s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bc19952f-24e6-4871-8eaf-1a09f83f27dd tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "cinder-2bb94dee-7410-49f2-bd9b-4e3747a9c943-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bc19952f-24e6-4871-8eaf-1a09f83f27dd tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-2bb94dee-7410-49f2-bd9b-4e3747a9c943-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bc19952f-24e6-4871-8eaf-1a09f83f27dd tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "cinder-quobyte-2bb94dee-7410-49f2-bd9b-4e3747a9c943" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:23:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bc19952f-24e6-4871-8eaf-1a09f83f27dd tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-quobyte-2bb94dee-7410-49f2-bd9b-4e3747a9c943" acquired by "delete_volume" :: waited 0.030s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:23:45 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ba8669-6144-411c-b21b-23d4ed481f4e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:23:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc19952f-24e6-4871-8eaf-1a09f83f27dd tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:45 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943 Sep 23 15:23:45 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:45 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc19952f-24e6-4871-8eaf-1a09f83f27dd tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943" returned: 0 in 0.414s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc19952f-24e6-4871-8eaf-1a09f83f27dd tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:45 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943 Sep 23 15:23:45 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:46 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc19952f-24e6-4871-8eaf-1a09f83f27dd tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2bb94dee-7410-49f2-bd9b-4e3747a9c943" returned: 0 in 0.280s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bc19952f-24e6-4871-8eaf-1a09f83f27dd tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-quobyte-2bb94dee-7410-49f2-bd9b-4e3747a9c943" released by "delete_volume" :: held 0.780s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:46 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-bc19952f-24e6-4871-8eaf-1a09f83f27dd tempest-CreateVolumesFromSnapshotTest-556594712 None] Created reservations ['b1c632b6-8fe5-4a29-8f64-577d2cbc0601', '4aae91b2-22ca-436c-94f0-9736af5579f1', '2c7a7428-f542-4973-bc07-41ef6e8aed69', '92582158-0f8b-4134-8939-b9b43f616bff'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:23:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bc19952f-24e6-4871-8eaf-1a09f83f27dd tempest-CreateVolumesFromSnapshotTest-556594712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bc19952f-24e6-4871-8eaf-1a09f83f27dd tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bc19952f-24e6-4871-8eaf-1a09f83f27dd tempest-CreateVolumesFromSnapshotTest-556594712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:23:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bc19952f-24e6-4871-8eaf-1a09f83f27dd tempest-CreateVolumesFromSnapshotTest-556594712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:23:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bc19952f-24e6-4871-8eaf-1a09f83f27dd tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc19952f-24e6-4871-8eaf-1a09f83f27dd tempest-CreateVolumesFromSnapshotTest-556594712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:46 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:23:46 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:46 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bc19952f-24e6-4871-8eaf-1a09f83f27dd tempest-CreateVolumesFromSnapshotTest-556594712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.290s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:46 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-bc19952f-24e6-4871-8eaf-1a09f83f27dd tempest-CreateVolumesFromSnapshotTest-556594712 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:23:46 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-bc19952f-24e6-4871-8eaf-1a09f83f27dd tempest-CreateVolumesFromSnapshotTest-556594712 None] Deleted volume successfully. Sep 23 15:23:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bc19952f-24e6-4871-8eaf-1a09f83f27dd tempest-CreateVolumesFromSnapshotTest-556594712 None] Lock "cinder-2bb94dee-7410-49f2-bd9b-4e3747a9c943-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:23:48 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:23:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Flow 'volume_create_manager' (8a302956-23a3-4a8e-a74b-86a09e3f414a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:23:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6b0404-87d3-4f01-9bb9-d691e80cd056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6b0404-87d3-4f01-9bb9-d691e80cd056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1365373841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=206ad736-224b-468d-9602-195499ee19be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636871f774b0494d95ef64dc158c45a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:23:49Z,use_quota=True,user_id='f21c160b30674103ab32c562568e62c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63f4434-6bd0-493f-98fe-e6db4c9d1782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63f4434-6bd0-493f-98fe-e6db4c9d1782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ace838-bc60-41d6-a5f8-c61dbcfb1e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ace838-bc60-41d6-a5f8-c61dbcfb1e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '206ad736-224b-468d-9602-195499ee19be', 'volume_name': 'volume-206ad736-224b-468d-9602-195499ee19be', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6330f5db-4ed3-4865-8b32-6749398a3df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6330f5db-4ed3-4865-8b32-6749398a3df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356f759f-93d0-47d7-8cb7-92c2e76e9dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:48 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Volume 206ad736-224b-468d-9602-195499ee19be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-206ad736-224b-468d-9602-195499ee19be', 'volume_size': 1} Sep 23 15:23:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1365373841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=206ad736-224b-468d-9602-195499ee19be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636871f774b0494d95ef64dc158c45a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:23:49Z,use_quota=True,user_id='f21c160b30674103ab32c562568e62c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:23:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Creating volume 206ad736-224b-468d-9602-195499ee19be {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:23:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:23:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:23:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:23:48 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:23:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-206ad736-224b-468d-9602-195499ee19be 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:49 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-206ad736-224b-468d-9602-195499ee19be 1073741824 Sep 23 15:23:49 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Flow 'volume_create_manager' (edc5fbc1-0fe2-47dc-8eec-1c9109e66e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (320c9499-e9d3-490c-83a7-559ca67ed050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (320c9499-e9d3-490c-83a7-559ca67ed050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-695627734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c595a219-67e6-4086-98ff-98cf6e064aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636871f774b0494d95ef64dc158c45a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:23:49Z,use_quota=True,user_id='f21c160b30674103ab32c562568e62c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (484bddde-c9b0-4780-9c39-4bc31106fcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (484bddde-c9b0-4780-9c39-4bc31106fcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a09b13-f525-47f1-805f-9e36720799a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a09b13-f525-47f1-805f-9e36720799a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c595a219-67e6-4086-98ff-98cf6e064aac', 'volume_name': 'volume-c595a219-67e6-4086-98ff-98cf6e064aac', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c4106e-1ac2-439b-af51-f2fac7e0429b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c4106e-1ac2-439b-af51-f2fac7e0429b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99787f4b-e7d8-426a-9b21-90a01e51a10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:49 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Volume c595a219-67e6-4086-98ff-98cf6e064aac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c595a219-67e6-4086-98ff-98cf6e064aac', 'volume_size': 1} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:49 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-206ad736-224b-468d-9602-195499ee19be 1073741824" returned: 0 in 0.585s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-206ad736-224b-468d-9602-195499ee19be {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:49 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-206ad736-224b-468d-9602-195499ee19be Sep 23 15:23:49 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:49 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-206ad736-224b-468d-9602-195499ee19be" returned: 0 in 0.301s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.423s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-695627734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c595a219-67e6-4086-98ff-98cf6e064aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636871f774b0494d95ef64dc158c45a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:23:49Z,use_quota=True,user_id='f21c160b30674103ab32c562568e62c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Creating volume c595a219-67e6-4086-98ff-98cf6e064aac {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:23:49 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c595a219-67e6-4086-98ff-98cf6e064aac 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356f759f-93d0-47d7-8cb7-92c2e76e9dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-206ad736-224b-468d-9602-195499ee19be', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:49 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c595a219-67e6-4086-98ff-98cf6e064aac 1073741824 Sep 23 15:23:49 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b34d003-a523-4427-8673-a6d9e35248c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:49 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Volume volume-206ad736-224b-468d-9602-195499ee19be (206ad736-224b-468d-9602-195499ee19be): created successfully Sep 23 15:23:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b34d003-a523-4427-8673-a6d9e35248c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Flow 'volume_create_manager' (8a302956-23a3-4a8e-a74b-86a09e3f414a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:23:50 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-eb1d126c-b6f7-48a7-8748-1b64957ca686 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Created volume successfully. Sep 23 15:23:50 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c595a219-67e6-4086-98ff-98cf6e064aac 1073741824" returned: 0 in 0.583s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c595a219-67e6-4086-98ff-98cf6e064aac {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:23:50 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c595a219-67e6-4086-98ff-98cf6e064aac Sep 23 15:23:50 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:23:50 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Sep 23 15:23:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c595a219-67e6-4086-98ff-98cf6e064aac" returned: 0 in 0.314s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:23:50 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:23:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:23:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99787f4b-e7d8-426a-9b21-90a01e51a10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c595a219-67e6-4086-98ff-98cf6e064aac', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769aa058-239f-49f3-a6dc-4f2d9218414e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:23:50 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Volume volume-c595a219-67e6-4086-98ff-98cf6e064aac (c595a219-67e6-4086-98ff-98cf6e064aac): created successfully Sep 23 15:23:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769aa058-239f-49f3-a6dc-4f2d9218414e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:23:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Flow 'volume_create_manager' (edc5fbc1-0fe2-47dc-8eec-1c9109e66e34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:23:50 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-790d02f4-7ce3-4f7f-b060-09bf8d0ac00c tempest-TestServerVolumeAttachmentScenario-1222618475 None] Created volume successfully. Sep 23 15:24:00 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=60,cinder:INSERT=23,cinder:UPDATE=100,cinder:DELETE=8 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:24:00 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:UPDATE=71,cinder:SELECT=55,cinder:INSERT=17,cinder:DELETE=7 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:24:18 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:24:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-a03ec900-990c-4ad4-b199-2017dd8897b1 req-1d95bb24-bb4e-4687-ba4b-2a91d8813d5f tempest-TestServerVolumeAttachmentScenario-1222618475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:24:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-a03ec900-990c-4ad4-b199-2017dd8897b1 req-1d95bb24-bb4e-4687-ba4b-2a91d8813d5f tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:24:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-a03ec900-990c-4ad4-b199-2017dd8897b1 req-1d95bb24-bb4e-4687-ba4b-2a91d8813d5f tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:24:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-a03ec900-990c-4ad4-b199-2017dd8897b1 req-1d95bb24-bb4e-4687-ba4b-2a91d8813d5f tempest-TestServerVolumeAttachmentScenario-1222618475 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-206ad736-224b-468d-9602-195499ee19be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ad88ef2-3b4f-4f34-a8a8-f69c5ff53b4d', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:24:21 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-a03ec900-990c-4ad4-b199-2017dd8897b1 req-1d95bb24-bb4e-4687-ba4b-2a91d8813d5f tempest-TestServerVolumeAttachmentScenario-1222618475 None] attachment_update completed successfully. Sep 23 15:24:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-fc8e122d-134b-4236-b9d7-fd56e481cdfc req-d5c2bd54-f3dc-4ad8-8447-9fec383e7f60 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:24:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-fc8e122d-134b-4236-b9d7-fd56e481cdfc req-d5c2bd54-f3dc-4ad8-8447-9fec383e7f60 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:24:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [req-fc8e122d-134b-4236-b9d7-fd56e481cdfc req-d5c2bd54-f3dc-4ad8-8447-9fec383e7f60 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:24:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-fc8e122d-134b-4236-b9d7-fd56e481cdfc req-d5c2bd54-f3dc-4ad8-8447-9fec383e7f60 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8', 'name': 'volume-c595a219-67e6-4086-98ff-98cf6e064aac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dbe993bd-2ec2-4308-9614-0104af69e9ac', 'enforce_multipath': True} {{(pid=86064) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 15:24:25 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-fc8e122d-134b-4236-b9d7-fd56e481cdfc req-d5c2bd54-f3dc-4ad8-8447-9fec383e7f60 tempest-TestServerVolumeAttachmentScenario-1222618475 None] attachment_update completed successfully. Sep 23 15:24:26 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-511aa6fc-a94e-4de0-8f3e-50154c256aa4 req-d9dc24b4-b32a-4347-a63f-ad71e75f413e tempest-TestServerVolumeAttachmentScenario-1222618475 None] Terminate volume connection completed successfully. Sep 23 15:24:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-511aa6fc-a94e-4de0-8f3e-50154c256aa4 req-d9dc24b4-b32a-4347-a63f-ad71e75f413e tempest-TestServerVolumeAttachmentScenario-1222618475 None] Deleting attachment dbe993bd-2ec2-4308-9614-0104af69e9ac. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:24:28 devstack cinder-volume[86064]: INFO cinder.volume.manager [req-6b0d8657-c8fb-4089-affc-cc3d78d59830 req-3728824c-38d3-4dc2-9b02-a1ee265b9f70 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Terminate volume connection completed successfully. Sep 23 15:24:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [req-6b0d8657-c8fb-4089-affc-cc3d78d59830 req-3728824c-38d3-4dc2-9b02-a1ee265b9f70 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Deleting attachment 2ad88ef2-3b4f-4f34-a8a8-f69c5ff53b4d. {{(pid=86064) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 15:24:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-579fefcb-5a6b-45b7-a68d-9c571b96f6f0 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Acquiring lock "cinder-c595a219-67e6-4086-98ff-98cf6e064aac-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:24:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-579fefcb-5a6b-45b7-a68d-9c571b96f6f0 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "cinder-c595a219-67e6-4086-98ff-98cf6e064aac-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:24:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-579fefcb-5a6b-45b7-a68d-9c571b96f6f0 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Acquiring lock "cinder-quobyte-c595a219-67e6-4086-98ff-98cf6e064aac" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:24:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-579fefcb-5a6b-45b7-a68d-9c571b96f6f0 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "cinder-quobyte-c595a219-67e6-4086-98ff-98cf6e064aac" acquired by "delete_volume" :: waited 0.014s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:24:32 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc015ba-8c58-4f2b-9378-f8e40e2984cc]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:24:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-579fefcb-5a6b-45b7-a68d-9c571b96f6f0 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c595a219-67e6-4086-98ff-98cf6e064aac {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:24:33 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c595a219-67e6-4086-98ff-98cf6e064aac Sep 23 15:24:33 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:24:33 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Sep 23 15:24:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-579fefcb-5a6b-45b7-a68d-9c571b96f6f0 tempest-TestServerVolumeAttachmentScenario-1222618475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c595a219-67e6-4086-98ff-98cf6e064aac" returned: 0 in 0.359s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:24:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-579fefcb-5a6b-45b7-a68d-9c571b96f6f0 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c595a219-67e6-4086-98ff-98cf6e064aac {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:24:33 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c595a219-67e6-4086-98ff-98cf6e064aac Sep 23 15:24:33 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:24:33 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Sep 23 15:24:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-579fefcb-5a6b-45b7-a68d-9c571b96f6f0 tempest-TestServerVolumeAttachmentScenario-1222618475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c595a219-67e6-4086-98ff-98cf6e064aac" returned: 0 in 0.259s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:24:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-579fefcb-5a6b-45b7-a68d-9c571b96f6f0 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "cinder-quobyte-c595a219-67e6-4086-98ff-98cf6e064aac" released by "delete_volume" :: held 0.662s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:24:33 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-579fefcb-5a6b-45b7-a68d-9c571b96f6f0 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Created reservations ['3f0e6209-8a70-4db3-a730-8b34788a85d5', 'a951f6dd-4e8c-4a44-a28a-8ba570374642', '15c5348f-4e2f-489a-8645-62157c3d5767', '8573e2d3-0859-4e7c-9f35-badb7c78a757'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:24:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-579fefcb-5a6b-45b7-a68d-9c571b96f6f0 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:24:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-579fefcb-5a6b-45b7-a68d-9c571b96f6f0 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:24:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-579fefcb-5a6b-45b7-a68d-9c571b96f6f0 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:24:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-579fefcb-5a6b-45b7-a68d-9c571b96f6f0 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:24:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-579fefcb-5a6b-45b7-a68d-9c571b96f6f0 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:24:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-579fefcb-5a6b-45b7-a68d-9c571b96f6f0 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:24:33 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:24:33 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:24:33 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Sep 23 15:24:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-579fefcb-5a6b-45b7-a68d-9c571b96f6f0 tempest-TestServerVolumeAttachmentScenario-1222618475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.276s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:24:33 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-579fefcb-5a6b-45b7-a68d-9c571b96f6f0 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:24:33 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-579fefcb-5a6b-45b7-a68d-9c571b96f6f0 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Deleted volume successfully. Sep 23 15:24:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-579fefcb-5a6b-45b7-a68d-9c571b96f6f0 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "cinder-c595a219-67e6-4086-98ff-98cf6e064aac-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:24:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9cdbd3d4-9aa0-4944-be61-e79366cf9066 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Acquiring lock "cinder-206ad736-224b-468d-9602-195499ee19be-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:24:34 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9cdbd3d4-9aa0-4944-be61-e79366cf9066 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "cinder-206ad736-224b-468d-9602-195499ee19be-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:24:34 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9cdbd3d4-9aa0-4944-be61-e79366cf9066 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Acquiring lock "cinder-quobyte-206ad736-224b-468d-9602-195499ee19be" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:24:34 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9cdbd3d4-9aa0-4944-be61-e79366cf9066 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "cinder-quobyte-206ad736-224b-468d-9602-195499ee19be" acquired by "delete_volume" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:24:34 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b98d0f0-badf-4f01-9383-1b0754ccad19]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:24:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9cdbd3d4-9aa0-4944-be61-e79366cf9066 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-206ad736-224b-468d-9602-195499ee19be {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:24:34 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-206ad736-224b-468d-9602-195499ee19be Sep 23 15:24:34 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:24:34 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Sep 23 15:24:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9cdbd3d4-9aa0-4944-be61-e79366cf9066 tempest-TestServerVolumeAttachmentScenario-1222618475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-206ad736-224b-468d-9602-195499ee19be" returned: 0 in 0.364s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:24:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9cdbd3d4-9aa0-4944-be61-e79366cf9066 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-206ad736-224b-468d-9602-195499ee19be {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:24:34 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-206ad736-224b-468d-9602-195499ee19be Sep 23 15:24:34 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:24:34 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Sep 23 15:24:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9cdbd3d4-9aa0-4944-be61-e79366cf9066 tempest-TestServerVolumeAttachmentScenario-1222618475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-206ad736-224b-468d-9602-195499ee19be" returned: 0 in 0.265s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:24:34 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9cdbd3d4-9aa0-4944-be61-e79366cf9066 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "cinder-quobyte-206ad736-224b-468d-9602-195499ee19be" released by "delete_volume" :: held 0.669s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:24:34 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-9cdbd3d4-9aa0-4944-be61-e79366cf9066 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Created reservations ['84c5b581-b8f0-4a62-8cb1-c81c4cb1af02', 'dad3ae40-75ca-4367-bda3-8c72b90017ea', '4d740e9d-dff9-43ef-8c2e-03df3d8f0952', '977915f5-8183-4e01-b35c-c7bc7bc0346b'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:24:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9cdbd3d4-9aa0-4944-be61-e79366cf9066 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:24:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9cdbd3d4-9aa0-4944-be61-e79366cf9066 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:24:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9cdbd3d4-9aa0-4944-be61-e79366cf9066 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:24:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9cdbd3d4-9aa0-4944-be61-e79366cf9066 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:24:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9cdbd3d4-9aa0-4944-be61-e79366cf9066 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:24:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9cdbd3d4-9aa0-4944-be61-e79366cf9066 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:24:34 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:24:34 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:24:35 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Sep 23 15:24:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9cdbd3d4-9aa0-4944-be61-e79366cf9066 tempest-TestServerVolumeAttachmentScenario-1222618475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.258s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:24:35 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-9cdbd3d4-9aa0-4944-be61-e79366cf9066 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:24:35 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-9cdbd3d4-9aa0-4944-be61-e79366cf9066 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Deleted volume successfully. Sep 23 15:24:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9cdbd3d4-9aa0-4944-be61-e79366cf9066 tempest-TestServerVolumeAttachmentScenario-1222618475 None] Lock "cinder-206ad736-224b-468d-9602-195499ee19be-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:24:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:24:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:24:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:24:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:24:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:24:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:24:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:24:36 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:24:36 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:24:36 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Sep 23 15:24:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.271s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:24:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:24:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:24:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 28 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:24:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:24:44 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=27,cinder:UPDATE=18,cinder:INSERT=4 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:24:45 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=23,cinder:UPDATE=20,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:25:08 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:25:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Flow 'volume_create_manager' (12c2d19a-74f0-4396-a99a-a0eaf626dbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:25:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d54dde-b6f7-42c4-8de1-c7eea3cdb59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d54dde-b6f7-42c4-8de1-c7eea3cdb59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-806420671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e19de6-4262-4c7d-a059-e076b2d8c101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='424ea90968cb4a809b3e0e1384b60478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:25:08Z,use_quota=True,user_id='250884542a4a42878ccf5232c70a6168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d21a136b-6a05-4a9e-9622-2403f73341fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d21a136b-6a05-4a9e-9622-2403f73341fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdcdc3a0-8a6d-40cb-97e9-b09badb25a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdcdc3a0-8a6d-40cb-97e9-b09badb25a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30e19de6-4262-4c7d-a059-e076b2d8c101', 'volume_name': 'volume-30e19de6-4262-4c7d-a059-e076b2d8c101', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1668e19-f32f-4613-a562-3ea4f6635706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1668e19-f32f-4613-a562-3ea4f6635706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:08 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03140f5a-46d4-437c-ba8a-c7123a411c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:08 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Volume 30e19de6-4262-4c7d-a059-e076b2d8c101: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30e19de6-4262-4c7d-a059-e076b2d8c101', 'volume_size': 1} Sep 23 15:25:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:25:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:25:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-806420671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e19de6-4262-4c7d-a059-e076b2d8c101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='424ea90968cb4a809b3e0e1384b60478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:25:08Z,use_quota=True,user_id='250884542a4a42878ccf5232c70a6168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:25:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Creating volume 30e19de6-4262-4c7d-a059-e076b2d8c101 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:25:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:25:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:25:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:25:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:25:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:25:08 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:25:08 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:25:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:08 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101 1073741824 Sep 23 15:25:08 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:09 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101 1073741824" returned: 0 in 0.446s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:09 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101 Sep 23 15:25:09 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:09 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101" returned: 0 in 0.245s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:09 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:25:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:25:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03140f5a-46d4-437c-ba8a-c7123a411c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e19de6-4262-4c7d-a059-e076b2d8c101', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1cb276-9e25-459f-9f74-858cfad9588e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:09 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Volume volume-30e19de6-4262-4c7d-a059-e076b2d8c101 (30e19de6-4262-4c7d-a059-e076b2d8c101): created successfully Sep 23 15:25:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1cb276-9e25-459f-9f74-858cfad9588e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Flow 'volume_create_manager' (12c2d19a-74f0-4396-a99a-a0eaf626dbf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:25:09 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-348d9462-08da-49fd-b5e0-b67225e647d1 tempest-TestImageHashVerification-1405420113 None] Created volume successfully. Sep 23 15:25:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f22e00c7-bad4-41af-a345-0ae322b4cf39 tempest-TestImageHashVerification-1405420113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:25:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f22e00c7-bad4-41af-a345-0ae322b4cf39 tempest-TestImageHashVerification-1405420113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:25:10 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fceda7f-0db2-4345-bb85-0449f5dc49bd]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:25:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f22e00c7-bad4-41af-a345-0ae322b4cf39 tempest-TestImageHashVerification-1405420113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:10 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101 Sep 23 15:25:10 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:10 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f22e00c7-bad4-41af-a345-0ae322b4cf39 tempest-TestImageHashVerification-1405420113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101" returned: 0 in 0.377s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:10 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d184ce-0b60-4b2b-8606-313cd850a967]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:25:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f22e00c7-bad4-41af-a345-0ae322b4cf39 tempest-TestImageHashVerification-1405420113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:10 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101 Sep 23 15:25:10 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:10 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f22e00c7-bad4-41af-a345-0ae322b4cf39 tempest-TestImageHashVerification-1405420113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101" returned: 0 in 0.362s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f22e00c7-bad4-41af-a345-0ae322b4cf39 tempest-TestImageHashVerification-1405420113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101 /opt/stack/data/cinder/conversion/30e19de6-4262-4c7d-a059-e076b2d8c101.temp_image.5df0e7b5-eb15-40cf-a85e-3409d333c427l6egsxe2.img {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:11 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101 /opt/stack/data/cinder/conversion/30e19de6-4262-4c7d-a059-e076b2d8c101.temp_image.5df0e7b5-eb15-40cf-a85e-3409d333c427l6egsxe2.img Sep 23 15:25:11 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:16 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f22e00c7-bad4-41af-a345-0ae322b4cf39 tempest-TestImageHashVerification-1405420113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101 /opt/stack/data/cinder/conversion/30e19de6-4262-4c7d-a059-e076b2d8c101.temp_image.5df0e7b5-eb15-40cf-a85e-3409d333c427l6egsxe2.img" returned: 0 in 5.766s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:16 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba0507d-e90e-41f2-b7b9-c4e0d7940f2c]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:25:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f22e00c7-bad4-41af-a345-0ae322b4cf39 tempest-TestImageHashVerification-1405420113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:16 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101 Sep 23 15:25:16 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:17 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f22e00c7-bad4-41af-a345-0ae322b4cf39 tempest-TestImageHashVerification-1405420113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101" returned: 0 in 0.554s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:17 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-f22e00c7-bad4-41af-a345-0ae322b4cf39 tempest-TestImageHashVerification-1405420113 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/conversion/30e19de6-4262-4c7d-a059-e076b2d8c101.temp_image.5df0e7b5-eb15-40cf-a85e-3409d333c427l6egsxe2.img {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:25:17 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-f22e00c7-bad4-41af-a345-0ae322b4cf39 tempest-TestImageHashVerification-1405420113 None] Converted 1024.00 MB image at 177.56 MB/s Sep 23 15:25:17 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-f22e00c7-bad4-41af-a345-0ae322b4cf39 tempest-TestImageHashVerification-1405420113 None] 5df0e7b5-eb15-40cf-a85e-3409d333c427 was raw, no need to convert to raw {{(pid=86064) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 23 15:25:20 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:25:27 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:UPDATE=4,cinder:INSERT=1,cinder:SELECT=2 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:25:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f22e00c7-bad4-41af-a345-0ae322b4cf39 tempest-TestImageHashVerification-1405420113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.388s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:25:35 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f22e00c7-bad4-41af-a345-0ae322b4cf39 tempest-TestImageHashVerification-1405420113 None] Uploaded volume to glance image-id: 5df0e7b5-eb15-40cf-a85e-3409d333c427. {{(pid=86064) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 15:25:35 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f22e00c7-bad4-41af-a345-0ae322b4cf39 tempest-TestImageHashVerification-1405420113 None] Copy volume to image completed successfully. Sep 23 15:25:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:25:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:25:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:25:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:25:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:25:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:25:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:36 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:25:36 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:36 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.260s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:25:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:25:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 28 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:25:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:25:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5e698d98-83d8-411b-b917-53e6a8716d9b tempest-TestImageHashVerification-1405420113 None] Acquiring lock "cinder-30e19de6-4262-4c7d-a059-e076b2d8c101-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:25:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5e698d98-83d8-411b-b917-53e6a8716d9b tempest-TestImageHashVerification-1405420113 None] Lock "cinder-30e19de6-4262-4c7d-a059-e076b2d8c101-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:25:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5e698d98-83d8-411b-b917-53e6a8716d9b tempest-TestImageHashVerification-1405420113 None] Acquiring lock "cinder-quobyte-30e19de6-4262-4c7d-a059-e076b2d8c101" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:25:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5e698d98-83d8-411b-b917-53e6a8716d9b tempest-TestImageHashVerification-1405420113 None] Lock "cinder-quobyte-30e19de6-4262-4c7d-a059-e076b2d8c101" acquired by "delete_volume" :: waited 0.014s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:25:36 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[6530f730-7402-4843-b95b-1908d478750f]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:25:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5e698d98-83d8-411b-b917-53e6a8716d9b tempest-TestImageHashVerification-1405420113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:36 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101 Sep 23 15:25:36 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:37 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5e698d98-83d8-411b-b917-53e6a8716d9b tempest-TestImageHashVerification-1405420113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101" returned: 0 in 0.372s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5e698d98-83d8-411b-b917-53e6a8716d9b tempest-TestImageHashVerification-1405420113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:37 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101 Sep 23 15:25:37 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:37 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5e698d98-83d8-411b-b917-53e6a8716d9b tempest-TestImageHashVerification-1405420113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-30e19de6-4262-4c7d-a059-e076b2d8c101" returned: 0 in 0.259s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5e698d98-83d8-411b-b917-53e6a8716d9b tempest-TestImageHashVerification-1405420113 None] Lock "cinder-quobyte-30e19de6-4262-4c7d-a059-e076b2d8c101" released by "delete_volume" :: held 0.671s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:25:37 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-5e698d98-83d8-411b-b917-53e6a8716d9b tempest-TestImageHashVerification-1405420113 None] Created reservations ['febd2c24-7cd0-4c6e-ab33-2a3fef9893c3', '37f60792-82a4-4700-bd90-bd46f1612720', 'a6c1b4b2-1bb1-420c-af62-3a7d30843797', '760180d2-ecc8-4369-a8bc-2016df02311b'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:25:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5e698d98-83d8-411b-b917-53e6a8716d9b tempest-TestImageHashVerification-1405420113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:25:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5e698d98-83d8-411b-b917-53e6a8716d9b tempest-TestImageHashVerification-1405420113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:25:37 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5e698d98-83d8-411b-b917-53e6a8716d9b tempest-TestImageHashVerification-1405420113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:25:37 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5e698d98-83d8-411b-b917-53e6a8716d9b tempest-TestImageHashVerification-1405420113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:25:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5e698d98-83d8-411b-b917-53e6a8716d9b tempest-TestImageHashVerification-1405420113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:25:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5e698d98-83d8-411b-b917-53e6a8716d9b tempest-TestImageHashVerification-1405420113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:37 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:25:37 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:37 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5e698d98-83d8-411b-b917-53e6a8716d9b tempest-TestImageHashVerification-1405420113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.249s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:37 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-5e698d98-83d8-411b-b917-53e6a8716d9b tempest-TestImageHashVerification-1405420113 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:25:37 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5e698d98-83d8-411b-b917-53e6a8716d9b tempest-TestImageHashVerification-1405420113 None] Deleted volume successfully. Sep 23 15:25:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5e698d98-83d8-411b-b917-53e6a8716d9b tempest-TestImageHashVerification-1405420113 None] Lock "cinder-30e19de6-4262-4c7d-a059-e076b2d8c101-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:25:47 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:UPDATE=10,cinder:SELECT=4,cinder:INSERT=3 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:25:47 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:25:48 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:25:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Flow 'volume_create_manager' (8152f289-a6ea-43a8-99b9-2697d0da3f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:25:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188c077f-959e-4824-a74d-c00bb5d48f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188c077f-959e-4824-a74d-c00bb5d48f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-130484220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d51429-9c9b-474c-ad4f-ac62b15fedff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e61b9a503e4155add8567ddba74d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:25:49Z,use_quota=True,user_id='5970bd4add4043a4b6c169c5d73d39d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5550bcd-b688-4a72-b977-a3e84dba8a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5550bcd-b688-4a72-b977-a3e84dba8a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aeed0ce-5d06-4959-887f-2df2b1ec5924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aeed0ce-5d06-4959-887f-2df2b1ec5924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8d51429-9c9b-474c-ad4f-ac62b15fedff', 'volume_name': 'volume-d8d51429-9c9b-474c-ad4f-ac62b15fedff', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f93b2b-d073-4d63-8700-5e8aefb6b078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f93b2b-d073-4d63-8700-5e8aefb6b078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd1f8b8-9092-48b7-b5dd-d3b86d5c95c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:48 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Volume d8d51429-9c9b-474c-ad4f-ac62b15fedff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8d51429-9c9b-474c-ad4f-ac62b15fedff', 'volume_size': 1} Sep 23 15:25:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:25:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:25:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-130484220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d51429-9c9b-474c-ad4f-ac62b15fedff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e61b9a503e4155add8567ddba74d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:25:49Z,use_quota=True,user_id='5970bd4add4043a4b6c169c5d73d39d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:25:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Creating volume d8d51429-9c9b-474c-ad4f-ac62b15fedff {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:25:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:25:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:25:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:25:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:25:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:25:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:25:48 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:25:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d8d51429-9c9b-474c-ad4f-ac62b15fedff 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:48 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d8d51429-9c9b-474c-ad4f-ac62b15fedff 1073741824 Sep 23 15:25:48 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Flow 'volume_create_manager' (011aada9-81fa-4546-a4b7-3c495f907762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (808c7e48-a614-4e3b-ba07-d1636c613247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (808c7e48-a614-4e3b-ba07-d1636c613247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-873393413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea6ac34-51da-4f5e-9e7a-11c89366dfa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e61b9a503e4155add8567ddba74d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:25:49Z,use_quota=True,user_id='5970bd4add4043a4b6c169c5d73d39d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e71e619-61d6-402c-936a-7924deb762cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e71e619-61d6-402c-936a-7924deb762cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b1e717-0e65-4e24-a573-f84b29276dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b1e717-0e65-4e24-a573-f84b29276dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ea6ac34-51da-4f5e-9e7a-11c89366dfa3', 'volume_name': 'volume-6ea6ac34-51da-4f5e-9e7a-11c89366dfa3', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099e9387-97a3-4f16-8dbb-c42427c6a6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099e9387-97a3-4f16-8dbb-c42427c6a6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f35fe0d3-c79c-4344-9ac2-4f248a0a0ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:49 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Volume 6ea6ac34-51da-4f5e-9e7a-11c89366dfa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ea6ac34-51da-4f5e-9e7a-11c89366dfa3', 'volume_size': 1} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:25:49 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d8d51429-9c9b-474c-ad4f-ac62b15fedff 1073741824" returned: 0 in 0.474s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d8d51429-9c9b-474c-ad4f-ac62b15fedff {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:49 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d8d51429-9c9b-474c-ad4f-ac62b15fedff Sep 23 15:25:49 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Flow 'volume_create_manager' (ec8e54c5-d539-476b-8fde-7d56e412cc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85efaf4a-da7f-4934-8344-f75cf3c0bf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85efaf4a-da7f-4934-8344-f75cf3c0bf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1386099126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b93068-3daa-4253-b18e-8f6118c490a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e61b9a503e4155add8567ddba74d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:25:50Z,use_quota=True,user_id='5970bd4add4043a4b6c169c5d73d39d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624cfebf-925c-4a8c-b41f-a5b8cf5da705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624cfebf-925c-4a8c-b41f-a5b8cf5da705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ac019f-b748-42d8-9d11-5cc1f13454e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ac019f-b748-42d8-9d11-5cc1f13454e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1b93068-3daa-4253-b18e-8f6118c490a4', 'volume_name': 'volume-a1b93068-3daa-4253-b18e-8f6118c490a4', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e77404e-1f8e-4609-ac57-3ccf6d351097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e77404e-1f8e-4609-ac57-3ccf6d351097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1a449e-4199-4ef7-9fd7-e32b68326118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:49 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Volume a1b93068-3daa-4253-b18e-8f6118c490a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1b93068-3daa-4253-b18e-8f6118c490a4', 'volume_size': 1} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:25:49 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d8d51429-9c9b-474c-ad4f-ac62b15fedff" returned: 0 in 0.316s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.490s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-873393413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea6ac34-51da-4f5e-9e7a-11c89366dfa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e61b9a503e4155add8567ddba74d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:25:49Z,use_quota=True,user_id='5970bd4add4043a4b6c169c5d73d39d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Creating volume 6ea6ac34-51da-4f5e-9e7a-11c89366dfa3 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:25:49 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6ea6ac34-51da-4f5e-9e7a-11c89366dfa3 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:49 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6ea6ac34-51da-4f5e-9e7a-11c89366dfa3 1073741824 Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd1f8b8-9092-48b7-b5dd-d3b86d5c95c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d51429-9c9b-474c-ad4f-ac62b15fedff', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:49 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a334ee29-56ef-4239-8df3-54a95a68735f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:49 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Volume volume-d8d51429-9c9b-474c-ad4f-ac62b15fedff (d8d51429-9c9b-474c-ad4f-ac62b15fedff): created successfully Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a334ee29-56ef-4239-8df3-54a95a68735f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Flow 'volume_create_manager' (8152f289-a6ea-43a8-99b9-2697d0da3f1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:25:49 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-fd0c878a-2eb4-48d9-bc9a-d9561ecbeb61 tempest-CreateVolumesFromImageTest-1041309491 None] Created volume successfully. Sep 23 15:25:49 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Flow 'volume_create_manager' (2cbf5e9b-0e13-4b60-ae67-a3725e4c2a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (127dab18-0b6a-4489-81c1-2f9c537755dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (127dab18-0b6a-4489-81c1-2f9c537755dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-548762883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75eafdc-5827-4738-88bd-2f83a146c07a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e61b9a503e4155add8567ddba74d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:25:50Z,use_quota=True,user_id='5970bd4add4043a4b6c169c5d73d39d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c71455-b343-4202-8aed-8797e33b211e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c71455-b343-4202-8aed-8797e33b211e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b034ff-0b9d-4aa0-9fc3-b6aee19ecab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b034ff-0b9d-4aa0-9fc3-b6aee19ecab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd75eafdc-5827-4738-88bd-2f83a146c07a', 'volume_name': 'volume-d75eafdc-5827-4738-88bd-2f83a146c07a', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8db4e80-454b-4076-8467-f33f11df364e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8db4e80-454b-4076-8467-f33f11df364e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4251872-eb57-4fc6-a3d5-8cceaaab3604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:50 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Volume d75eafdc-5827-4738-88bd-2f83a146c07a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d75eafdc-5827-4738-88bd-2f83a146c07a', 'volume_size': 1} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:25:50 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6ea6ac34-51da-4f5e-9e7a-11c89366dfa3 1073741824" returned: 0 in 0.519s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6ea6ac34-51da-4f5e-9e7a-11c89366dfa3 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:50 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6ea6ac34-51da-4f5e-9e7a-11c89366dfa3 Sep 23 15:25:50 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Flow 'volume_create_manager' (7587ae9b-5a21-4b25-a052-da7cbe668e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ea40d5-cff5-49ed-b429-c4b5d3e02c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ea40d5-cff5-49ed-b429-c4b5d3e02c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1131979806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e61b9a503e4155add8567ddba74d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:25:50Z,use_quota=True,user_id='5970bd4add4043a4b6c169c5d73d39d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542b0b95-d6dd-45f5-87ae-152e99d72fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542b0b95-d6dd-45f5-87ae-152e99d72fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e019ced3-cc40-4bc2-8c83-0856977d6a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e019ced3-cc40-4bc2-8c83-0856977d6a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd29a88a8-c5f2-4123-b5f9-e93b8a0ab78c', 'volume_name': 'volume-d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6856aec-08e4-4cc9-bc0e-0eee6972e26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6856aec-08e4-4cc9-bc0e-0eee6972e26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2dea86d-7ea2-4103-90eb-be76496993ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:50 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Volume d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c', 'volume_size': 1} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:25:50 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6ea6ac34-51da-4f5e-9e7a-11c89366dfa3" returned: 0 in 0.264s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.865s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1386099126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b93068-3daa-4253-b18e-8f6118c490a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e61b9a503e4155add8567ddba74d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:25:50Z,use_quota=True,user_id='5970bd4add4043a4b6c169c5d73d39d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Creating volume a1b93068-3daa-4253-b18e-8f6118c490a4 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:25:50 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a1b93068-3daa-4253-b18e-8f6118c490a4 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:50 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a1b93068-3daa-4253-b18e-8f6118c490a4 1073741824 Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f35fe0d3-c79c-4344-9ac2-4f248a0a0ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ea6ac34-51da-4f5e-9e7a-11c89366dfa3', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:50 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12131f17-206a-4913-87a4-8b157ce1fe9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:50 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Volume volume-6ea6ac34-51da-4f5e-9e7a-11c89366dfa3 (6ea6ac34-51da-4f5e-9e7a-11c89366dfa3): created successfully Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12131f17-206a-4913-87a4-8b157ce1fe9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Flow 'volume_create_manager' (011aada9-81fa-4546-a4b7-3c495f907762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:25:50 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-65b861ce-5952-4b55-aab7-ab584ae789a2 tempest-CreateVolumesFromImageTest-1041309491 None] Created volume successfully. Sep 23 15:25:50 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a1b93068-3daa-4253-b18e-8f6118c490a4 1073741824" returned: 0 in 0.415s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a1b93068-3daa-4253-b18e-8f6118c490a4 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:51 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a1b93068-3daa-4253-b18e-8f6118c490a4 Sep 23 15:25:51 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:51 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a1b93068-3daa-4253-b18e-8f6118c490a4" returned: 0 in 0.249s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.171s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-548762883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75eafdc-5827-4738-88bd-2f83a146c07a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e61b9a503e4155add8567ddba74d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:25:50Z,use_quota=True,user_id='5970bd4add4043a4b6c169c5d73d39d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Creating volume d75eafdc-5827-4738-88bd-2f83a146c07a {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:25:51 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d75eafdc-5827-4738-88bd-2f83a146c07a 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1a449e-4199-4ef7-9fd7-e32b68326118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1b93068-3daa-4253-b18e-8f6118c490a4', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:51 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d75eafdc-5827-4738-88bd-2f83a146c07a 1073741824 Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05e9f7e-cedb-4845-a74d-1d88081fcc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:51 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:51 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Volume volume-a1b93068-3daa-4253-b18e-8f6118c490a4 (a1b93068-3daa-4253-b18e-8f6118c490a4): created successfully Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05e9f7e-cedb-4845-a74d-1d88081fcc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Flow 'volume_create_manager' (ec8e54c5-d539-476b-8fde-7d56e412cc2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:25:51 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-8e8df33e-c62b-48a7-8aab-504565491e6a tempest-CreateVolumesFromImageTest-1041309491 None] Created volume successfully. Sep 23 15:25:51 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d75eafdc-5827-4738-88bd-2f83a146c07a 1073741824" returned: 0 in 0.416s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d75eafdc-5827-4738-88bd-2f83a146c07a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:51 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d75eafdc-5827-4738-88bd-2f83a146c07a Sep 23 15:25:51 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:51 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d75eafdc-5827-4738-88bd-2f83a146c07a" returned: 0 in 0.241s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.497s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1131979806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e61b9a503e4155add8567ddba74d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:25:50Z,use_quota=True,user_id='5970bd4add4043a4b6c169c5d73d39d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Creating volume d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:25:51 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4251872-eb57-4fc6-a3d5-8cceaaab3604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d75eafdc-5827-4738-88bd-2f83a146c07a', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:51 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c 1073741824 Sep 23 15:25:51 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:51 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cf1c8a-cd89-4541-9501-1e0baf8995b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:52 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Volume volume-d75eafdc-5827-4738-88bd-2f83a146c07a (d75eafdc-5827-4738-88bd-2f83a146c07a): created successfully Sep 23 15:25:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cf1c8a-cd89-4541-9501-1e0baf8995b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Flow 'volume_create_manager' (2cbf5e9b-0e13-4b60-ae67-a3725e4c2a26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:25:52 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-8d007a98-58eb-4a01-856a-42a20452d899 tempest-CreateVolumesFromImageTest-1041309491 None] Created volume successfully. Sep 23 15:25:52 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c 1073741824" returned: 0 in 0.403s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:52 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c Sep 23 15:25:52 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:52 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c" returned: 0 in 0.252s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:25:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:25:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2dea86d-7ea2-4103-90eb-be76496993ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f4f0987-4ed8-4354-8a6c-08c888f07c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:25:52 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Volume volume-d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c (d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c): created successfully Sep 23 15:25:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f4f0987-4ed8-4354-8a6c-08c888f07c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:25:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Flow 'volume_create_manager' (7587ae9b-5a21-4b25-a052-da7cbe668e31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:25:52 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-b3b4f7c2-956a-42c7-b605-a2c57215d754 tempest-CreateVolumesFromImageTest-1041309491 None] Created volume successfully. Sep 23 15:25:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e090b5e3-d91f-46f0-908a-59edf4b920da tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "cinder-d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:25:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e090b5e3-d91f-46f0-908a-59edf4b920da tempest-CreateVolumesFromImageTest-1041309491 None] Lock "cinder-d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:25:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e090b5e3-d91f-46f0-908a-59edf4b920da tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "cinder-quobyte-d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:25:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e090b5e3-d91f-46f0-908a-59edf4b920da tempest-CreateVolumesFromImageTest-1041309491 None] Lock "cinder-quobyte-d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c" acquired by "delete_volume" :: waited 0.014s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:25:53 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cdf59e-0200-42ef-84e5-b01f4b2de1eb]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:25:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e090b5e3-d91f-46f0-908a-59edf4b920da tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:53 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c Sep 23 15:25:53 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:54 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e090b5e3-d91f-46f0-908a-59edf4b920da tempest-CreateVolumesFromImageTest-1041309491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c" returned: 0 in 0.360s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e090b5e3-d91f-46f0-908a-59edf4b920da tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:54 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c Sep 23 15:25:54 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:54 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e090b5e3-d91f-46f0-908a-59edf4b920da tempest-CreateVolumesFromImageTest-1041309491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c" returned: 0 in 0.244s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:54 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e090b5e3-d91f-46f0-908a-59edf4b920da tempest-CreateVolumesFromImageTest-1041309491 None] Lock "cinder-quobyte-d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c" released by "delete_volume" :: held 0.644s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:25:54 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-e090b5e3-d91f-46f0-908a-59edf4b920da tempest-CreateVolumesFromImageTest-1041309491 None] Created reservations ['a95ff619-02f6-4109-b9e1-f424194f729f', '5696dc9b-d09d-4480-8cfe-4794f28b9157', '80975563-2463-441b-ab21-67c962589cc3', '96122fd1-4cf1-428e-a95a-5f33eff906fe'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:25:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e090b5e3-d91f-46f0-908a-59edf4b920da tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:25:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e090b5e3-d91f-46f0-908a-59edf4b920da tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:25:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e090b5e3-d91f-46f0-908a-59edf4b920da tempest-CreateVolumesFromImageTest-1041309491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:25:54 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e090b5e3-d91f-46f0-908a-59edf4b920da tempest-CreateVolumesFromImageTest-1041309491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:25:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e090b5e3-d91f-46f0-908a-59edf4b920da tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:25:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e090b5e3-d91f-46f0-908a-59edf4b920da tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:54 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:25:54 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:54 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e090b5e3-d91f-46f0-908a-59edf4b920da tempest-CreateVolumesFromImageTest-1041309491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.239s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:54 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-e090b5e3-d91f-46f0-908a-59edf4b920da tempest-CreateVolumesFromImageTest-1041309491 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:25:54 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-e090b5e3-d91f-46f0-908a-59edf4b920da tempest-CreateVolumesFromImageTest-1041309491 None] Deleted volume successfully. Sep 23 15:25:54 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e090b5e3-d91f-46f0-908a-59edf4b920da tempest-CreateVolumesFromImageTest-1041309491 None] Lock "cinder-d29a88a8-c5f2-4123-b5f9-e93b8a0ab78c-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:25:54 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6531092c-230e-4287-803c-9eea69c14b88 tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "cinder-d75eafdc-5827-4738-88bd-2f83a146c07a-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:25:54 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6531092c-230e-4287-803c-9eea69c14b88 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "cinder-d75eafdc-5827-4738-88bd-2f83a146c07a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:25:54 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6531092c-230e-4287-803c-9eea69c14b88 tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "cinder-quobyte-d75eafdc-5827-4738-88bd-2f83a146c07a" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:25:54 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6531092c-230e-4287-803c-9eea69c14b88 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "cinder-quobyte-d75eafdc-5827-4738-88bd-2f83a146c07a" acquired by "delete_volume" :: waited 0.016s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:25:54 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[11543651-a2be-464c-ba31-17deb61b8235]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:25:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6531092c-230e-4287-803c-9eea69c14b88 tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d75eafdc-5827-4738-88bd-2f83a146c07a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:55 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d75eafdc-5827-4738-88bd-2f83a146c07a Sep 23 15:25:55 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:55 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6531092c-230e-4287-803c-9eea69c14b88 tempest-CreateVolumesFromImageTest-1041309491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d75eafdc-5827-4738-88bd-2f83a146c07a" returned: 0 in 0.355s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6531092c-230e-4287-803c-9eea69c14b88 tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d75eafdc-5827-4738-88bd-2f83a146c07a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:55 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d75eafdc-5827-4738-88bd-2f83a146c07a Sep 23 15:25:55 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:55 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6531092c-230e-4287-803c-9eea69c14b88 tempest-CreateVolumesFromImageTest-1041309491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d75eafdc-5827-4738-88bd-2f83a146c07a" returned: 0 in 0.238s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:55 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6531092c-230e-4287-803c-9eea69c14b88 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "cinder-quobyte-d75eafdc-5827-4738-88bd-2f83a146c07a" released by "delete_volume" :: held 0.632s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:25:55 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-6531092c-230e-4287-803c-9eea69c14b88 tempest-CreateVolumesFromImageTest-1041309491 None] Created reservations ['6fb5dd73-4a6b-4617-a814-5eb14a16e5de', 'e3fcba16-511e-4d98-bc4e-4cb156434aa1', '0981c886-8056-4fe7-bd15-b6525886247b', '22d1b26b-1d6b-4125-9623-a863f663660c'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:25:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6531092c-230e-4287-803c-9eea69c14b88 tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:25:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6531092c-230e-4287-803c-9eea69c14b88 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:25:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6531092c-230e-4287-803c-9eea69c14b88 tempest-CreateVolumesFromImageTest-1041309491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:25:55 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6531092c-230e-4287-803c-9eea69c14b88 tempest-CreateVolumesFromImageTest-1041309491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:25:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6531092c-230e-4287-803c-9eea69c14b88 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:25:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6531092c-230e-4287-803c-9eea69c14b88 tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:55 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:25:55 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:55 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6531092c-230e-4287-803c-9eea69c14b88 tempest-CreateVolumesFromImageTest-1041309491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.246s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:55 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-6531092c-230e-4287-803c-9eea69c14b88 tempest-CreateVolumesFromImageTest-1041309491 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:25:55 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-6531092c-230e-4287-803c-9eea69c14b88 tempest-CreateVolumesFromImageTest-1041309491 None] Deleted volume successfully. Sep 23 15:25:55 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6531092c-230e-4287-803c-9eea69c14b88 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "cinder-d75eafdc-5827-4738-88bd-2f83a146c07a-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:25:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a0b63c82-e5cd-4f5f-bcd1-8be6b6e6f631 tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "cinder-a1b93068-3daa-4253-b18e-8f6118c490a4-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:25:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a0b63c82-e5cd-4f5f-bcd1-8be6b6e6f631 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "cinder-a1b93068-3daa-4253-b18e-8f6118c490a4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:25:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a0b63c82-e5cd-4f5f-bcd1-8be6b6e6f631 tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "cinder-quobyte-a1b93068-3daa-4253-b18e-8f6118c490a4" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:25:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a0b63c82-e5cd-4f5f-bcd1-8be6b6e6f631 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "cinder-quobyte-a1b93068-3daa-4253-b18e-8f6118c490a4" acquired by "delete_volume" :: waited 0.015s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:25:56 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[05123267-f3c0-4f25-b227-ef861d05ba3f]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:25:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a0b63c82-e5cd-4f5f-bcd1-8be6b6e6f631 tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a1b93068-3daa-4253-b18e-8f6118c490a4 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:56 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a1b93068-3daa-4253-b18e-8f6118c490a4 Sep 23 15:25:56 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:56 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a0b63c82-e5cd-4f5f-bcd1-8be6b6e6f631 tempest-CreateVolumesFromImageTest-1041309491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a1b93068-3daa-4253-b18e-8f6118c490a4" returned: 0 in 0.371s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a0b63c82-e5cd-4f5f-bcd1-8be6b6e6f631 tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a1b93068-3daa-4253-b18e-8f6118c490a4 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:56 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a1b93068-3daa-4253-b18e-8f6118c490a4 Sep 23 15:25:56 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:56 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a0b63c82-e5cd-4f5f-bcd1-8be6b6e6f631 tempest-CreateVolumesFromImageTest-1041309491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a1b93068-3daa-4253-b18e-8f6118c490a4" returned: 0 in 0.243s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a0b63c82-e5cd-4f5f-bcd1-8be6b6e6f631 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "cinder-quobyte-a1b93068-3daa-4253-b18e-8f6118c490a4" released by "delete_volume" :: held 0.657s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:25:56 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-a0b63c82-e5cd-4f5f-bcd1-8be6b6e6f631 tempest-CreateVolumesFromImageTest-1041309491 None] Created reservations ['b2de3f20-7943-40c2-a755-9764dd29f877', '3ee2907e-af60-452a-8b15-8048e34a1a9c', '168579b6-577e-4a0f-8fca-681854f6ec34', '233b264e-6a06-4d3c-a167-4ea9d87f5eff'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:25:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a0b63c82-e5cd-4f5f-bcd1-8be6b6e6f631 tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:25:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a0b63c82-e5cd-4f5f-bcd1-8be6b6e6f631 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:25:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a0b63c82-e5cd-4f5f-bcd1-8be6b6e6f631 tempest-CreateVolumesFromImageTest-1041309491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:25:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a0b63c82-e5cd-4f5f-bcd1-8be6b6e6f631 tempest-CreateVolumesFromImageTest-1041309491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:25:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a0b63c82-e5cd-4f5f-bcd1-8be6b6e6f631 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:25:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a0b63c82-e5cd-4f5f-bcd1-8be6b6e6f631 tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:56 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:25:56 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:57 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a0b63c82-e5cd-4f5f-bcd1-8be6b6e6f631 tempest-CreateVolumesFromImageTest-1041309491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.247s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:57 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-a0b63c82-e5cd-4f5f-bcd1-8be6b6e6f631 tempest-CreateVolumesFromImageTest-1041309491 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:25:57 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-a0b63c82-e5cd-4f5f-bcd1-8be6b6e6f631 tempest-CreateVolumesFromImageTest-1041309491 None] Deleted volume successfully. Sep 23 15:25:57 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a0b63c82-e5cd-4f5f-bcd1-8be6b6e6f631 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "cinder-a1b93068-3daa-4253-b18e-8f6118c490a4-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:25:57 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-23bdf38f-c49d-4064-aec2-f759e02d67c7 tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "cinder-6ea6ac34-51da-4f5e-9e7a-11c89366dfa3-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:25:57 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-23bdf38f-c49d-4064-aec2-f759e02d67c7 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "cinder-6ea6ac34-51da-4f5e-9e7a-11c89366dfa3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:25:57 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-23bdf38f-c49d-4064-aec2-f759e02d67c7 tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "cinder-quobyte-6ea6ac34-51da-4f5e-9e7a-11c89366dfa3" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:25:57 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-23bdf38f-c49d-4064-aec2-f759e02d67c7 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "cinder-quobyte-6ea6ac34-51da-4f5e-9e7a-11c89366dfa3" acquired by "delete_volume" :: waited 0.015s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:25:57 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b87f3e6-5fbc-4baa-8189-37c6cf8a0ec2]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:25:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-23bdf38f-c49d-4064-aec2-f759e02d67c7 tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6ea6ac34-51da-4f5e-9e7a-11c89366dfa3 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:57 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6ea6ac34-51da-4f5e-9e7a-11c89366dfa3 Sep 23 15:25:57 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:57 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-23bdf38f-c49d-4064-aec2-f759e02d67c7 tempest-CreateVolumesFromImageTest-1041309491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6ea6ac34-51da-4f5e-9e7a-11c89366dfa3" returned: 0 in 0.368s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-23bdf38f-c49d-4064-aec2-f759e02d67c7 tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6ea6ac34-51da-4f5e-9e7a-11c89366dfa3 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:57 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6ea6ac34-51da-4f5e-9e7a-11c89366dfa3 Sep 23 15:25:57 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:57 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-23bdf38f-c49d-4064-aec2-f759e02d67c7 tempest-CreateVolumesFromImageTest-1041309491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6ea6ac34-51da-4f5e-9e7a-11c89366dfa3" returned: 0 in 0.243s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:57 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-23bdf38f-c49d-4064-aec2-f759e02d67c7 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "cinder-quobyte-6ea6ac34-51da-4f5e-9e7a-11c89366dfa3" released by "delete_volume" :: held 0.650s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:25:57 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-23bdf38f-c49d-4064-aec2-f759e02d67c7 tempest-CreateVolumesFromImageTest-1041309491 None] Created reservations ['2612f2aa-802b-4140-b330-e115c4d08895', 'eaf5dbb6-2f58-4a85-9ece-fdb66eeaf7de', '8787f509-9115-480b-a3a2-63e04a7d87b5', '518ff6a9-3a83-479a-a7a5-28c919824626'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:25:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-23bdf38f-c49d-4064-aec2-f759e02d67c7 tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:25:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-23bdf38f-c49d-4064-aec2-f759e02d67c7 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:25:58 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-23bdf38f-c49d-4064-aec2-f759e02d67c7 tempest-CreateVolumesFromImageTest-1041309491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:25:58 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-23bdf38f-c49d-4064-aec2-f759e02d67c7 tempest-CreateVolumesFromImageTest-1041309491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:25:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-23bdf38f-c49d-4064-aec2-f759e02d67c7 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:25:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-23bdf38f-c49d-4064-aec2-f759e02d67c7 tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:58 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:25:58 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:58 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-23bdf38f-c49d-4064-aec2-f759e02d67c7 tempest-CreateVolumesFromImageTest-1041309491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.244s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:58 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-23bdf38f-c49d-4064-aec2-f759e02d67c7 tempest-CreateVolumesFromImageTest-1041309491 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:25:58 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-23bdf38f-c49d-4064-aec2-f759e02d67c7 tempest-CreateVolumesFromImageTest-1041309491 None] Deleted volume successfully. Sep 23 15:25:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-23bdf38f-c49d-4064-aec2-f759e02d67c7 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "cinder-6ea6ac34-51da-4f5e-9e7a-11c89366dfa3-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:25:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b88730f0-063b-4c53-9dcb-aefb0709e664 tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "cinder-d8d51429-9c9b-474c-ad4f-ac62b15fedff-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:25:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b88730f0-063b-4c53-9dcb-aefb0709e664 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "cinder-d8d51429-9c9b-474c-ad4f-ac62b15fedff-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:25:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b88730f0-063b-4c53-9dcb-aefb0709e664 tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "cinder-quobyte-d8d51429-9c9b-474c-ad4f-ac62b15fedff" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:25:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b88730f0-063b-4c53-9dcb-aefb0709e664 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "cinder-quobyte-d8d51429-9c9b-474c-ad4f-ac62b15fedff" acquired by "delete_volume" :: waited 0.014s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:25:58 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a00f99-92ce-4dc2-a3a8-e3068c8cd73f]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:25:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b88730f0-063b-4c53-9dcb-aefb0709e664 tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d8d51429-9c9b-474c-ad4f-ac62b15fedff {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:58 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d8d51429-9c9b-474c-ad4f-ac62b15fedff Sep 23 15:25:58 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:58 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b88730f0-063b-4c53-9dcb-aefb0709e664 tempest-CreateVolumesFromImageTest-1041309491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d8d51429-9c9b-474c-ad4f-ac62b15fedff" returned: 0 in 0.356s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b88730f0-063b-4c53-9dcb-aefb0709e664 tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d8d51429-9c9b-474c-ad4f-ac62b15fedff {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:58 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d8d51429-9c9b-474c-ad4f-ac62b15fedff Sep 23 15:25:58 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:59 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b88730f0-063b-4c53-9dcb-aefb0709e664 tempest-CreateVolumesFromImageTest-1041309491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d8d51429-9c9b-474c-ad4f-ac62b15fedff" returned: 0 in 0.240s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b88730f0-063b-4c53-9dcb-aefb0709e664 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "cinder-quobyte-d8d51429-9c9b-474c-ad4f-ac62b15fedff" released by "delete_volume" :: held 0.635s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:25:59 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-b88730f0-063b-4c53-9dcb-aefb0709e664 tempest-CreateVolumesFromImageTest-1041309491 None] Created reservations ['fbfb4d85-ed7c-4669-aeb8-1c3b4317b1f7', '66923918-9997-46ff-ab4b-b2e4a1b88401', '93ddfe4b-7e8d-4e2f-aa58-a92e70d5ed1e', 'd4d8c985-f68f-4b86-ae08-e37c39fd43bd'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:25:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b88730f0-063b-4c53-9dcb-aefb0709e664 tempest-CreateVolumesFromImageTest-1041309491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:25:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b88730f0-063b-4c53-9dcb-aefb0709e664 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:25:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b88730f0-063b-4c53-9dcb-aefb0709e664 tempest-CreateVolumesFromImageTest-1041309491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:25:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b88730f0-063b-4c53-9dcb-aefb0709e664 tempest-CreateVolumesFromImageTest-1041309491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:25:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b88730f0-063b-4c53-9dcb-aefb0709e664 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:25:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b88730f0-063b-4c53-9dcb-aefb0709e664 tempest-CreateVolumesFromImageTest-1041309491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:25:59 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:25:59 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:25:59 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Sep 23 15:25:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b88730f0-063b-4c53-9dcb-aefb0709e664 tempest-CreateVolumesFromImageTest-1041309491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.246s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:25:59 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-b88730f0-063b-4c53-9dcb-aefb0709e664 tempest-CreateVolumesFromImageTest-1041309491 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:25:59 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-b88730f0-063b-4c53-9dcb-aefb0709e664 tempest-CreateVolumesFromImageTest-1041309491 None] Deleted volume successfully. Sep 23 15:25:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b88730f0-063b-4c53-9dcb-aefb0709e664 tempest-CreateVolumesFromImageTest-1041309491 None] Lock "cinder-d8d51429-9c9b-474c-ad4f-ac62b15fedff-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:26:09 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=34,cinder:UPDATE=60,cinder:INSERT=12,cinder:DELETE=6 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:26:18 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=37,cinder:UPDATE=51,cinder:INSERT=13,cinder:DELETE=4 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:26:23 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Flow 'volume_create_manager' (0c3e813d-71bd-43f9-9429-7e493a7a0edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df76e9c8-1ecf-42df-9d87-4f55b45f1c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df76e9c8-1ecf-42df-9d87-4f55b45f1c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-907227730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9a70fe-cd76-4c03-a626-12d028de8e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc545c377f744194b3dbc7238346a77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:26:24Z,use_quota=True,user_id='af28d8feba51494b81ca77c364d111de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30569872-a291-4222-a5e6-f5aebfa626e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30569872-a291-4222-a5e6-f5aebfa626e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd796df7-6f17-4f9f-a375-66cf928b5bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd796df7-6f17-4f9f-a375-66cf928b5bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb9a70fe-cd76-4c03-a626-12d028de8e26', 'volume_name': 'volume-fb9a70fe-cd76-4c03-a626-12d028de8e26', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ac03a4-d8f1-4847-b7fe-b4207bea407c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ac03a4-d8f1-4847-b7fe-b4207bea407c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94983a1-1e27-49b3-85b4-bd059889fbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:26:24 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Volume fb9a70fe-cd76-4c03-a626-12d028de8e26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb9a70fe-cd76-4c03-a626-12d028de8e26', 'volume_size': 1} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-907227730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9a70fe-cd76-4c03-a626-12d028de8e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc545c377f744194b3dbc7238346a77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:26:24Z,use_quota=True,user_id='af28d8feba51494b81ca77c364d111de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Creating volume fb9a70fe-cd76-4c03-a626-12d028de8e26 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:26:24 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:24 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 1073741824 Sep 23 15:26:24 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:24 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 1073741824" returned: 0 in 0.463s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:24 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 Sep 23 15:26:24 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:24 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26" returned: 0 in 0.271s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94983a1-1e27-49b3-85b4-bd059889fbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb9a70fe-cd76-4c03-a626-12d028de8e26', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a3ca5fc-a51d-4d0f-8c92-145c97130e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:26:24 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Volume volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 (fb9a70fe-cd76-4c03-a626-12d028de8e26): created successfully Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a3ca5fc-a51d-4d0f-8c92-145c97130e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:26:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Flow 'volume_create_manager' (0c3e813d-71bd-43f9-9429-7e493a7a0edc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:26:24 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-9f54a5b7-29f0-4361-bb63-148abc2d1af6 tempest-SnapshotDependencyTests-464644349 None] Created volume successfully. Sep 23 15:26:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8c384f66-d5d2-45ba-8cc0-1e6a55688cd6 tempest-SnapshotDependencyTests-464644349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:26:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8c384f66-d5d2-45ba-8cc0-1e6a55688cd6 tempest-SnapshotDependencyTests-464644349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:26:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-8c384f66-d5d2-45ba-8cc0-1e6a55688cd6 tempest-SnapshotDependencyTests-464644349 None] Creating offline snapshot 255158e8-953e-4ad4-928b-54195d0bc5c5 of volume fb9a70fe-cd76-4c03-a626-12d028de8e26 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:26:26 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[16269014-0461-468b-899a-50264e310559]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:26:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8c384f66-d5d2-45ba-8cc0-1e6a55688cd6 tempest-SnapshotDependencyTests-464644349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:26 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 Sep 23 15:26:26 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:26 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8c384f66-d5d2-45ba-8cc0-1e6a55688cd6 tempest-SnapshotDependencyTests-464644349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26" returned: 0 in 0.366s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8c384f66-d5d2-45ba-8cc0-1e6a55688cd6 tempest-SnapshotDependencyTests-464644349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:26 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5 1G Sep 23 15:26:26 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:27 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8c384f66-d5d2-45ba-8cc0-1e6a55688cd6 tempest-SnapshotDependencyTests-464644349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5 1G" returned: 0 in 0.387s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8c384f66-d5d2-45ba-8cc0-1e6a55688cd6 tempest-SnapshotDependencyTests-464644349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:27 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5 Sep 23 15:26:27 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:27 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8c384f66-d5d2-45ba-8cc0-1e6a55688cd6 tempest-SnapshotDependencyTests-464644349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5" returned: 0 in 0.287s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:27 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-8c384f66-d5d2-45ba-8cc0-1e6a55688cd6 tempest-SnapshotDependencyTests-464644349 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5 is being set with open permissions: ugo+rw Sep 23 15:26:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8c384f66-d5d2-45ba-8cc0-1e6a55688cd6 tempest-SnapshotDependencyTests-464644349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:27 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5 Sep 23 15:26:27 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:27 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8c384f66-d5d2-45ba-8cc0-1e6a55688cd6 tempest-SnapshotDependencyTests-464644349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5" returned: 0 in 0.256s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8c384f66-d5d2-45ba-8cc0-1e6a55688cd6 tempest-SnapshotDependencyTests-464644349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:27 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.info Sep 23 15:26:27 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:27 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8c384f66-d5d2-45ba-8cc0-1e6a55688cd6 tempest-SnapshotDependencyTests-464644349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.info" returned: 0 in 0.265s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:27 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-8c384f66-d5d2-45ba-8cc0-1e6a55688cd6 tempest-SnapshotDependencyTests-464644349 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.info is being set with open permissions: ugo+rw Sep 23 15:26:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8c384f66-d5d2-45ba-8cc0-1e6a55688cd6 tempest-SnapshotDependencyTests-464644349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:27 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.info Sep 23 15:26:27 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:28 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8c384f66-d5d2-45ba-8cc0-1e6a55688cd6 tempest-SnapshotDependencyTests-464644349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.info" returned: 0 in 0.245s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-8c384f66-d5d2-45ba-8cc0-1e6a55688cd6 tempest-SnapshotDependencyTests-464644349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.891s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:26:28 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-8c384f66-d5d2-45ba-8cc0-1e6a55688cd6 tempest-SnapshotDependencyTests-464644349 None] Create snapshot completed successfully Sep 23 15:26:28 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:26:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Flow 'volume_create_manager' (27c7b352-e299-4295-b2a6-63ab7749ea6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:26:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d256b9e-c552-4606-8ccf-1d9232155df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d256b9e-c552-4606-8ccf-1d9232155df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2dea4b4-723a-4ecd-9750-2b32cfd38249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc545c377f744194b3dbc7238346a77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=255158e8-953e-4ad4-928b-54195d0bc5c5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:26:29Z,use_quota=True,user_id='af28d8feba51494b81ca77c364d111de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6246b4bb-b5f1-4427-b7f4-4779e5f3aa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6246b4bb-b5f1-4427-b7f4-4779e5f3aa7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62142d3c-9bfb-4438-b69a-fadff0794b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62142d3c-9bfb-4438-b69a-fadff0794b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c2dea4b4-723a-4ecd-9750-2b32cfd38249', 'volume_name': 'volume-c2dea4b4-723a-4ecd-9750-2b32cfd38249', 'volume_size': 1, 'snapshot_id': '255158e8-953e-4ad4-928b-54195d0bc5c5'}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2418993f-c573-4a95-a6d7-4f0b96d9f83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2418993f-c573-4a95-a6d7-4f0b96d9f83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b35ef4-ceeb-44d9-b153-ba459745fb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:26:29 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Volume c2dea4b4-723a-4ecd-9750-2b32cfd38249: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c2dea4b4-723a-4ecd-9750-2b32cfd38249', 'volume_size': 1, 'snapshot_id': '255158e8-953e-4ad4-928b-54195d0bc5c5'} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Acquiring lock "cinder-quobyte-255158e8-953e-4ad4-928b-54195d0bc5c5-c2dea4b4-723a-4ecd-9750-2b32cfd38249" by "_create_volume_from_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Lock "cinder-quobyte-255158e8-953e-4ad4-928b-54195d0bc5c5-c2dea4b4-723a-4ecd-9750-2b32cfd38249" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Creating volume c2dea4b4-723a-4ecd-9750-2b32cfd38249 from snapshot 255158e8-953e-4ad4-928b-54195d0bc5c5 {{(pid=86064) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Acquiring lock "cinder-quobyte-c2dea4b4-723a-4ecd-9750-2b32cfd38249" by "_copy_volume_from_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Lock "cinder-quobyte-c2dea4b4-723a-4ecd-9750-2b32cfd38249" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] snapshot: 255158e8-953e-4ad4-928b-54195d0bc5c5, volume: c2dea4b4-723a-4ecd-9750-2b32cfd38249, {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab6a7ea-bc53-4af7-b2cd-9fb6f5b1c887]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:29 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5 Sep 23 15:26:29 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:29 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5" returned: 0 in 0.366s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb9a70fe-cd76-4c03-a626-12d028de8e26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9dc058-88d8-4879-b5d8-a4dd215383c7]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:29 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 Sep 23 15:26:29 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:29 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26" returned: 0 in 0.379s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Creating direct copy from snapshot {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG cinder.utils [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Path /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c2dea4b4-723a-4ecd-9750-2b32cfd38249 not found in is_blk_device check {{(pid=86064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 15:26:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c2dea4b4-723a-4ecd-9750-2b32cfd38249 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:29 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c2dea4b4-723a-4ecd-9750-2b32cfd38249 Sep 23 15:26:29 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:36 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c2dea4b4-723a-4ecd-9750-2b32cfd38249" returned: 0 in 6.120s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26, size 1024.00 MB, duration 6.12 sec, destination /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c2dea4b4-723a-4ecd-9750-2b32cfd38249 {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:26:36 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Converted 1024.00 MB image at 167.25 MB/s Sep 23 15:26:36 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c2dea4b4-723a-4ecd-9750-2b32cfd38249 is being set with open permissions: ugo+rw Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c2dea4b4-723a-4ecd-9750-2b32cfd38249 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:36 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c2dea4b4-723a-4ecd-9750-2b32cfd38249 Sep 23 15:26:36 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:36 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:26:36 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:36 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c2dea4b4-723a-4ecd-9750-2b32cfd38249" returned: 0 in 0.254s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Lock "cinder-quobyte-c2dea4b4-723a-4ecd-9750-2b32cfd38249" released by "_copy_volume_from_snapshot" :: held 7.202s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Lock "cinder-quobyte-255158e8-953e-4ad4-928b-54195d0bc5c5-c2dea4b4-723a-4ecd-9750-2b32cfd38249" released by "_create_volume_from_snapshot" :: held 7.272s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.290s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b35ef4-ceeb-44d9-b153-ba459745fb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2dea4b4-723a-4ecd-9750-2b32cfd38249', 'volume_size': 1, 'snapshot_id': '255158e8-953e-4ad4-928b-54195d0bc5c5'}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac75821-4438-4bfc-a58a-8e4ced829a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:26:36 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.269s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:26:36 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Volume volume-c2dea4b4-723a-4ecd-9750-2b32cfd38249 (c2dea4b4-723a-4ecd-9750-2b32cfd38249): created successfully Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac75821-4438-4bfc-a58a-8e4ced829a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Flow 'volume_create_manager' (27c7b352-e299-4295-b2a6-63ab7749ea6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 28 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:26:36 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-a51da15d-67ef-4854-8656-ec708dd4184d tempest-SnapshotDependencyTests-464644349 None] Created volume successfully. Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9d13226c-94cd-4672-bb14-ad9d921c1bab tempest-SnapshotDependencyTests-464644349 None] Acquiring lock "cinder-255158e8-953e-4ad4-928b-54195d0bc5c5-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9d13226c-94cd-4672-bb14-ad9d921c1bab tempest-SnapshotDependencyTests-464644349 None] Lock "cinder-255158e8-953e-4ad4-928b-54195d0bc5c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9d13226c-94cd-4672-bb14-ad9d921c1bab tempest-SnapshotDependencyTests-464644349 None] Acquiring lock "cinder-quobyte-fb9a70fe-cd76-4c03-a626-12d028de8e26" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9d13226c-94cd-4672-bb14-ad9d921c1bab tempest-SnapshotDependencyTests-464644349 None] Lock "cinder-quobyte-fb9a70fe-cd76-4c03-a626-12d028de8e26" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9d13226c-94cd-4672-bb14-ad9d921c1bab tempest-SnapshotDependencyTests-464644349 None] Acquiring lock "cinder-quobyte-255158e8-953e-4ad4-928b-54195d0bc5c5" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9d13226c-94cd-4672-bb14-ad9d921c1bab tempest-SnapshotDependencyTests-464644349 None] Lock "cinder-quobyte-255158e8-953e-4ad4-928b-54195d0bc5c5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-9d13226c-94cd-4672-bb14-ad9d921c1bab tempest-SnapshotDependencyTests-464644349 None] Deleting offline snapshot 255158e8-953e-4ad4-928b-54195d0bc5c5 of volume fb9a70fe-cd76-4c03-a626-12d028de8e26 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-9d13226c-94cd-4672-bb14-ad9d921c1bab tempest-SnapshotDependencyTests-464644349 None] snapshot_file for this snap is: volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8affd55-316c-42ae-bf49-eacee6dada6a]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:26:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9d13226c-94cd-4672-bb14-ad9d921c1bab tempest-SnapshotDependencyTests-464644349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:36 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5 Sep 23 15:26:36 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:37 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9d13226c-94cd-4672-bb14-ad9d921c1bab tempest-SnapshotDependencyTests-464644349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5" returned: 0 in 0.370s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:37 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-9d13226c-94cd-4672-bb14-ad9d921c1bab tempest-SnapshotDependencyTests-464644349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb9a70fe-cd76-4c03-a626-12d028de8e26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:26:37 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eba851f-e921-4686-a201-16c2f238e3d1]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:26:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9d13226c-94cd-4672-bb14-ad9d921c1bab tempest-SnapshotDependencyTests-464644349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:37 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 Sep 23 15:26:37 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:37 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9d13226c-94cd-4672-bb14-ad9d921c1bab tempest-SnapshotDependencyTests-464644349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26" returned: 0 in 0.562s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9d13226c-94cd-4672-bb14-ad9d921c1bab tempest-SnapshotDependencyTests-464644349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:37 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5 Sep 23 15:26:37 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:38 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9d13226c-94cd-4672-bb14-ad9d921c1bab tempest-SnapshotDependencyTests-464644349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5" returned: 0 in 0.334s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9d13226c-94cd-4672-bb14-ad9d921c1bab tempest-SnapshotDependencyTests-464644349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:38 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5 Sep 23 15:26:38 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:38 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9d13226c-94cd-4672-bb14-ad9d921c1bab tempest-SnapshotDependencyTests-464644349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26.255158e8-953e-4ad4-928b-54195d0bc5c5" returned: 0 in 0.264s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9d13226c-94cd-4672-bb14-ad9d921c1bab tempest-SnapshotDependencyTests-464644349 None] Lock "cinder-quobyte-255158e8-953e-4ad4-928b-54195d0bc5c5" released by "_delete_snapshot" :: held 1.631s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:26:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9d13226c-94cd-4672-bb14-ad9d921c1bab tempest-SnapshotDependencyTests-464644349 None] Lock "cinder-quobyte-fb9a70fe-cd76-4c03-a626-12d028de8e26" released by "delete_snapshot" :: held 1.653s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:26:38 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-9d13226c-94cd-4672-bb14-ad9d921c1bab tempest-SnapshotDependencyTests-464644349 None] Created reservations ['f31dd4ef-5868-4bbb-b13c-3401a9ab7695', '7950fbc0-7d93-4bbe-9d0e-d3f2eb302dd5', '9691f7af-ff6b-44e2-9194-57fe2f3be08d', '75c7b8dd-3071-4a87-ae44-a58ce39fe82a'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:26:38 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-9d13226c-94cd-4672-bb14-ad9d921c1bab tempest-SnapshotDependencyTests-464644349 None] Delete snapshot completed successfully. Sep 23 15:26:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9d13226c-94cd-4672-bb14-ad9d921c1bab tempest-SnapshotDependencyTests-464644349 None] Lock "cinder-255158e8-953e-4ad4-928b-54195d0bc5c5-delete_snapshot" released by "delete_snapshot" :: held 1.781s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:26:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ec41598d-e6b3-4c50-b1cf-8a3337a47e11 tempest-SnapshotDependencyTests-464644349 None] Acquiring lock "cinder-fb9a70fe-cd76-4c03-a626-12d028de8e26-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:26:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ec41598d-e6b3-4c50-b1cf-8a3337a47e11 tempest-SnapshotDependencyTests-464644349 None] Lock "cinder-fb9a70fe-cd76-4c03-a626-12d028de8e26-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:26:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ec41598d-e6b3-4c50-b1cf-8a3337a47e11 tempest-SnapshotDependencyTests-464644349 None] Acquiring lock "cinder-quobyte-fb9a70fe-cd76-4c03-a626-12d028de8e26" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:26:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ec41598d-e6b3-4c50-b1cf-8a3337a47e11 tempest-SnapshotDependencyTests-464644349 None] Lock "cinder-quobyte-fb9a70fe-cd76-4c03-a626-12d028de8e26" acquired by "delete_volume" :: waited 0.015s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:26:38 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3bb3f5-5631-4de7-b4da-2e1bfab6823d]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:26:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ec41598d-e6b3-4c50-b1cf-8a3337a47e11 tempest-SnapshotDependencyTests-464644349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:39 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 Sep 23 15:26:39 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:39 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ec41598d-e6b3-4c50-b1cf-8a3337a47e11 tempest-SnapshotDependencyTests-464644349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26" returned: 0 in 0.384s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ec41598d-e6b3-4c50-b1cf-8a3337a47e11 tempest-SnapshotDependencyTests-464644349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:39 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26 Sep 23 15:26:39 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:39 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ec41598d-e6b3-4c50-b1cf-8a3337a47e11 tempest-SnapshotDependencyTests-464644349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fb9a70fe-cd76-4c03-a626-12d028de8e26" returned: 0 in 0.243s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ec41598d-e6b3-4c50-b1cf-8a3337a47e11 tempest-SnapshotDependencyTests-464644349 None] Lock "cinder-quobyte-fb9a70fe-cd76-4c03-a626-12d028de8e26" released by "delete_volume" :: held 0.694s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:26:39 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-ec41598d-e6b3-4c50-b1cf-8a3337a47e11 tempest-SnapshotDependencyTests-464644349 None] Created reservations ['d8acd7f7-7df5-476a-b284-b7bf2693139b', 'f56653f9-4683-4454-8932-28008e5e2667', '66992655-912e-4be1-a834-20dceb3dec84', '6001cab0-5fdb-4f5f-a02f-aef0941411b6'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:26:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ec41598d-e6b3-4c50-b1cf-8a3337a47e11 tempest-SnapshotDependencyTests-464644349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:26:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ec41598d-e6b3-4c50-b1cf-8a3337a47e11 tempest-SnapshotDependencyTests-464644349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:26:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ec41598d-e6b3-4c50-b1cf-8a3337a47e11 tempest-SnapshotDependencyTests-464644349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:26:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-ec41598d-e6b3-4c50-b1cf-8a3337a47e11 tempest-SnapshotDependencyTests-464644349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:26:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ec41598d-e6b3-4c50-b1cf-8a3337a47e11 tempest-SnapshotDependencyTests-464644349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:26:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ec41598d-e6b3-4c50-b1cf-8a3337a47e11 tempest-SnapshotDependencyTests-464644349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:39 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:26:39 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:39 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ec41598d-e6b3-4c50-b1cf-8a3337a47e11 tempest-SnapshotDependencyTests-464644349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.270s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:39 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-ec41598d-e6b3-4c50-b1cf-8a3337a47e11 tempest-SnapshotDependencyTests-464644349 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:26:39 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-ec41598d-e6b3-4c50-b1cf-8a3337a47e11 tempest-SnapshotDependencyTests-464644349 None] Deleted volume successfully. Sep 23 15:26:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-337a10ad-ef6c-47c4-a7ff-68bf2552fee9 tempest-SnapshotDependencyTests-464644349 None] Acquiring lock "cinder-c2dea4b4-723a-4ecd-9750-2b32cfd38249-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:26:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ec41598d-e6b3-4c50-b1cf-8a3337a47e11 tempest-SnapshotDependencyTests-464644349 None] Lock "cinder-fb9a70fe-cd76-4c03-a626-12d028de8e26-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:26:40 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-337a10ad-ef6c-47c4-a7ff-68bf2552fee9 tempest-SnapshotDependencyTests-464644349 None] Lock "cinder-c2dea4b4-723a-4ecd-9750-2b32cfd38249-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:26:40 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-337a10ad-ef6c-47c4-a7ff-68bf2552fee9 tempest-SnapshotDependencyTests-464644349 None] Acquiring lock "cinder-quobyte-c2dea4b4-723a-4ecd-9750-2b32cfd38249" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:26:40 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-337a10ad-ef6c-47c4-a7ff-68bf2552fee9 tempest-SnapshotDependencyTests-464644349 None] Lock "cinder-quobyte-c2dea4b4-723a-4ecd-9750-2b32cfd38249" acquired by "delete_volume" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:26:40 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c51423b-3d9e-4691-bf8d-04a10c380217]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:26:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-337a10ad-ef6c-47c4-a7ff-68bf2552fee9 tempest-SnapshotDependencyTests-464644349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c2dea4b4-723a-4ecd-9750-2b32cfd38249 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:40 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c2dea4b4-723a-4ecd-9750-2b32cfd38249 Sep 23 15:26:40 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:40 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-337a10ad-ef6c-47c4-a7ff-68bf2552fee9 tempest-SnapshotDependencyTests-464644349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c2dea4b4-723a-4ecd-9750-2b32cfd38249" returned: 0 in 0.368s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-337a10ad-ef6c-47c4-a7ff-68bf2552fee9 tempest-SnapshotDependencyTests-464644349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c2dea4b4-723a-4ecd-9750-2b32cfd38249 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:40 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c2dea4b4-723a-4ecd-9750-2b32cfd38249 Sep 23 15:26:40 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:40 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-337a10ad-ef6c-47c4-a7ff-68bf2552fee9 tempest-SnapshotDependencyTests-464644349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c2dea4b4-723a-4ecd-9750-2b32cfd38249" returned: 0 in 0.241s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:40 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-337a10ad-ef6c-47c4-a7ff-68bf2552fee9 tempest-SnapshotDependencyTests-464644349 None] Lock "cinder-quobyte-c2dea4b4-723a-4ecd-9750-2b32cfd38249" released by "delete_volume" :: held 0.655s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:26:40 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-337a10ad-ef6c-47c4-a7ff-68bf2552fee9 tempest-SnapshotDependencyTests-464644349 None] Created reservations ['56338550-9537-4238-bf31-dd5fc0524f9c', '27a8cc20-fcb0-42da-979c-0d6f04fe21c7', '4b7cc057-d408-4ce7-8ed3-286becb3b060', 'bd5c1a9f-1502-45dd-b0e5-df0ea743be2c'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:26:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-337a10ad-ef6c-47c4-a7ff-68bf2552fee9 tempest-SnapshotDependencyTests-464644349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:26:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-337a10ad-ef6c-47c4-a7ff-68bf2552fee9 tempest-SnapshotDependencyTests-464644349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:26:40 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-337a10ad-ef6c-47c4-a7ff-68bf2552fee9 tempest-SnapshotDependencyTests-464644349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:26:40 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-337a10ad-ef6c-47c4-a7ff-68bf2552fee9 tempest-SnapshotDependencyTests-464644349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:26:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-337a10ad-ef6c-47c4-a7ff-68bf2552fee9 tempest-SnapshotDependencyTests-464644349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:26:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-337a10ad-ef6c-47c4-a7ff-68bf2552fee9 tempest-SnapshotDependencyTests-464644349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:26:40 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:26:40 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:26:41 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Sep 23 15:26:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-337a10ad-ef6c-47c4-a7ff-68bf2552fee9 tempest-SnapshotDependencyTests-464644349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.236s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:26:41 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-337a10ad-ef6c-47c4-a7ff-68bf2552fee9 tempest-SnapshotDependencyTests-464644349 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:26:41 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-337a10ad-ef6c-47c4-a7ff-68bf2552fee9 tempest-SnapshotDependencyTests-464644349 None] Deleted volume successfully. Sep 23 15:26:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-337a10ad-ef6c-47c4-a7ff-68bf2552fee9 tempest-SnapshotDependencyTests-464644349 None] Lock "cinder-c2dea4b4-723a-4ecd-9750-2b32cfd38249-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:26:50 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=27,cinder:UPDATE=32,cinder:DELETE=2,cinder:INSERT=6 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:26:51 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=22,cinder:INSERT=9,cinder:UPDATE=26,cinder:DELETE=3 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Flow 'volume_create_manager' (0e2e2c3d-ed86-4840-a4e8-24b2d2b9b8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf82103-1671-4801-ba3d-585885b78ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf82103-1671-4801-ba3d-585885b78ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1267742835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbcf3690-8340-420d-89fb-ef77138e587b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6500f60cb7e74552ba4dd0c3425a658c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:01Z,use_quota=True,user_id='1feb0484ad8b4dcabfec6764142757a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8358bf60-0454-4d27-b816-4278c5bece7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8358bf60-0454-4d27-b816-4278c5bece7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814df1a8-40e1-4ca9-a6ed-48a9355eba19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814df1a8-40e1-4ca9-a6ed-48a9355eba19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbcf3690-8340-420d-89fb-ef77138e587b', 'volume_name': 'volume-bbcf3690-8340-420d-89fb-ef77138e587b', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe3f2838-d92e-477e-862a-c9e9de90a1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe3f2838-d92e-477e-862a-c9e9de90a1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffad9a77-245a-4673-bdb3-5c1c3c6cd8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:01 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Volume bbcf3690-8340-420d-89fb-ef77138e587b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbcf3690-8340-420d-89fb-ef77138e587b', 'volume_size': 1} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1267742835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbcf3690-8340-420d-89fb-ef77138e587b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6500f60cb7e74552ba4dd0c3425a658c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:01Z,use_quota=True,user_id='1feb0484ad8b4dcabfec6764142757a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Creating volume bbcf3690-8340-420d-89fb-ef77138e587b {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:01 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bbcf3690-8340-420d-89fb-ef77138e587b 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:01 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bbcf3690-8340-420d-89fb-ef77138e587b 1073741824 Sep 23 15:27:01 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Flow 'volume_create_manager' (01b0a46f-b030-4701-9033-be8421e6d9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6e4ac0-e32d-467b-8013-ee12774bd661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6e4ac0-e32d-467b-8013-ee12774bd661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-574106569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d39188bf-6cbe-4f2e-a109-53ab3e9a68fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050f744a9cf348d6a433f5deee9438b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:02Z,use_quota=True,user_id='8362b0639f364e3fbd9eff55f1e4a680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6642d6d-8d58-4eb4-9d0f-7cfe1cff6b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6642d6d-8d58-4eb4-9d0f-7cfe1cff6b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47bfbdf4-eca2-4973-9db6-d0affb82304f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47bfbdf4-eca2-4973-9db6-d0affb82304f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd39188bf-6cbe-4f2e-a109-53ab3e9a68fb', 'volume_name': 'volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ff8095-373f-49db-9679-e7b5033fa0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ff8095-373f-49db-9679-e7b5033fa0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf479473-26d3-4d17-beac-bd2c3fa3ec93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:01 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Volume d39188bf-6cbe-4f2e-a109-53ab3e9a68fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb', 'volume_size': 1} Sep 23 15:27:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Flow 'volume_create_manager' (90404584-0d2e-4efd-b74b-0407b7a67e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:02 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5480826-c8b6-4117-92fa-a3cb77e458bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bbcf3690-8340-420d-89fb-ef77138e587b 1073741824" returned: 0 in 0.580s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f947b08-a56c-4aa8-9d96-4c52412a66a3 tempest-ProjectAdminTests-1882869099 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4478797912598, 'free_capacity_gb': 1775.4478797912598, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86064) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5480826-c8b6-4117-92fa-a3cb77e458bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1760855300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2799bec1-67e6-4f6b-bb9e-e9e51d26148e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6500f60cb7e74552ba4dd0c3425a658c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:02Z,use_quota=True,user_id='1feb0484ad8b4dcabfec6764142757a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d265f78-9b2a-432d-ac2b-d6c4fb2af2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d265f78-9b2a-432d-ac2b-d6c4fb2af2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b974b419-2335-4d79-b1dd-8f217997111d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b974b419-2335-4d79-b1dd-8f217997111d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2799bec1-67e6-4f6b-bb9e-e9e51d26148e', 'volume_name': 'volume-2799bec1-67e6-4f6b-bb9e-e9e51d26148e', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88730c05-7979-4b42-bea1-8c32e1193bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88730c05-7979-4b42-bea1-8c32e1193bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6074dddd-549f-4354-8310-cd8dc2704fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:02 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Volume 2799bec1-67e6-4f6b-bb9e-e9e51d26148e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2799bec1-67e6-4f6b-bb9e-e9e51d26148e', 'volume_size': 1} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bbcf3690-8340-420d-89fb-ef77138e587b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:02 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bbcf3690-8340-420d-89fb-ef77138e587b Sep 23 15:27:02 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Flow 'volume_create_manager' (2aa729dc-ec0d-4d77-b986-2eaf989be637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17fcce24-737e-4c28-9ec6-0b618e78cddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17fcce24-737e-4c28-9ec6-0b618e78cddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1950432040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6500f60cb7e74552ba4dd0c3425a658c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:02Z,use_quota=True,user_id='1feb0484ad8b4dcabfec6764142757a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0ed1d7-343b-4b78-add2-78f7742e5f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0ed1d7-343b-4b78-add2-78f7742e5f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (316d3bcd-ed63-4739-88c1-7c08b9f9a6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (316d3bcd-ed63-4739-88c1-7c08b9f9a6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832', 'volume_name': 'volume-99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:02 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bea00f4-feb6-4bec-bcad-8dbf8a2ed2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bea00f4-feb6-4bec-bcad-8dbf8a2ed2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61da33cb-0e18-4f34-a653-77cd592ef9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:02 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Volume 99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832', 'volume_size': 1} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bbcf3690-8340-420d-89fb-ef77138e587b" returned: 0 in 0.385s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.757s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-574106569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d39188bf-6cbe-4f2e-a109-53ab3e9a68fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050f744a9cf348d6a433f5deee9438b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:02Z,use_quota=True,user_id='8362b0639f364e3fbd9eff55f1e4a680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Creating volume d39188bf-6cbe-4f2e-a109-53ab3e9a68fb {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:02 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffad9a77-245a-4673-bdb3-5c1c3c6cd8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbcf3690-8340-420d-89fb-ef77138e587b', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2806cbb3-5545-42db-9bfd-f2b046963be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:02 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb 1073741824 Sep 23 15:27:02 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:02 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Volume volume-bbcf3690-8340-420d-89fb-ef77138e587b (bbcf3690-8340-420d-89fb-ef77138e587b): created successfully Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2806cbb3-5545-42db-9bfd-f2b046963be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Flow 'volume_create_manager' (0e2e2c3d-ed86-4840-a4e8-24b2d2b9b8c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:02 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5ffdc93d-9080-420e-950f-325d9448f746 tempest-CreateVolumesFromImageTest-1053775227 None] Created volume successfully. Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Flow 'volume_create_manager' (106003b1-3eb1-495a-8c65-d7108f44c980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb12154-92db-4af5-bd87-2938a0618138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb12154-92db-4af5-bd87-2938a0618138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-371396671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f1cd98-1519-411f-96dc-b09cf1483c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6500f60cb7e74552ba4dd0c3425a658c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:03Z,use_quota=True,user_id='1feb0484ad8b4dcabfec6764142757a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6668dc5c-b80a-4160-9103-c50044f32fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6668dc5c-b80a-4160-9103-c50044f32fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5cd021-5869-46e8-ac0b-0fc9274f61fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5cd021-5869-46e8-ac0b-0fc9274f61fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38f1cd98-1519-411f-96dc-b09cf1483c01', 'volume_name': 'volume-38f1cd98-1519-411f-96dc-b09cf1483c01', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2686fc6-6fde-463f-86a1-26a442e62143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2686fc6-6fde-463f-86a1-26a442e62143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0765bffd-9b2d-4725-af7d-9499f7e85291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:03 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Volume 38f1cd98-1519-411f-96dc-b09cf1483c01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38f1cd98-1519-411f-96dc-b09cf1483c01', 'volume_size': 1} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Flow 'volume_create_manager' (be92aaa4-c0e3-4596-a4f9-d3566c32eb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c73196f-5d36-4842-8e59-acc9818fcaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c73196f-5d36-4842-8e59-acc9818fcaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-405864766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc9a94de-c636-4121-a2e7-004b6df82a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6500f60cb7e74552ba4dd0c3425a658c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:03Z,use_quota=True,user_id='1feb0484ad8b4dcabfec6764142757a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41232d3b-2ad7-437e-b402-bd62787620ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41232d3b-2ad7-437e-b402-bd62787620ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65693150-455e-4696-86cc-e17775a1d291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65693150-455e-4696-86cc-e17775a1d291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc9a94de-c636-4121-a2e7-004b6df82a50', 'volume_name': 'volume-cc9a94de-c636-4121-a2e7-004b6df82a50', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7264db44-743e-4e5c-a008-8778dcd97b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7264db44-743e-4e5c-a008-8778dcd97b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03dfc623-48bc-497c-bc76-135fce5eb9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:03 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Volume cc9a94de-c636-4121-a2e7-004b6df82a50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc9a94de-c636-4121-a2e7-004b6df82a50', 'volume_size': 1} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:03 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb 1073741824" returned: 0 in 0.998s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:03 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb Sep 23 15:27:03 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:03 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb" returned: 0 in 0.292s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.783s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1760855300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2799bec1-67e6-4f6b-bb9e-e9e51d26148e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6500f60cb7e74552ba4dd0c3425a658c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:02Z,use_quota=True,user_id='1feb0484ad8b4dcabfec6764142757a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Creating volume 2799bec1-67e6-4f6b-bb9e-e9e51d26148e {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:03 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2799bec1-67e6-4f6b-bb9e-e9e51d26148e 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf479473-26d3-4d17-beac-bd2c3fa3ec93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc89103-b65d-4c9d-86d9-0346b51840e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:04 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2799bec1-67e6-4f6b-bb9e-e9e51d26148e 1073741824 Sep 23 15:27:04 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:04 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Volume volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb (d39188bf-6cbe-4f2e-a109-53ab3e9a68fb): created successfully Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc89103-b65d-4c9d-86d9-0346b51840e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Flow 'volume_create_manager' (01b0a46f-b030-4701-9033-be8421e6d9c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:04 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-76ac90d3-b772-4603-b2bf-07c84dac3600 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Created volume successfully. Sep 23 15:27:04 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2799bec1-67e6-4f6b-bb9e-e9e51d26148e 1073741824" returned: 0 in 0.577s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2799bec1-67e6-4f6b-bb9e-e9e51d26148e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:04 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2799bec1-67e6-4f6b-bb9e-e9e51d26148e Sep 23 15:27:04 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:04 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2799bec1-67e6-4f6b-bb9e-e9e51d26148e" returned: 0 in 0.265s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.272s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1950432040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6500f60cb7e74552ba4dd0c3425a658c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:02Z,use_quota=True,user_id='1feb0484ad8b4dcabfec6764142757a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Creating volume 99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:04 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6074dddd-549f-4354-8310-cd8dc2704fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2799bec1-67e6-4f6b-bb9e-e9e51d26148e', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b321d59-e232-4769-b346-68193b10a984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:04 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832 1073741824 Sep 23 15:27:04 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:04 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Volume volume-2799bec1-67e6-4f6b-bb9e-e9e51d26148e (2799bec1-67e6-4f6b-bb9e-e9e51d26148e): created successfully Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b321d59-e232-4769-b346-68193b10a984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:04 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Flow 'volume_create_manager' (90404584-0d2e-4efd-b74b-0407b7a67e91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:04 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-0d29110c-b83e-459d-a064-efce38db8f33 tempest-CreateVolumesFromImageTest-1053775227 None] Created volume successfully. Sep 23 15:27:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-78ea83f0-c6a8-4af9-a688-2a17f19dc75b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:05 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832 1073741824" returned: 0 in 0.639s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:05 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832 Sep 23 15:27:05 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:05 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832" returned: 0 in 0.304s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.516s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-371396671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f1cd98-1519-411f-96dc-b09cf1483c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6500f60cb7e74552ba4dd0c3425a658c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:03Z,use_quota=True,user_id='1feb0484ad8b4dcabfec6764142757a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Creating volume 38f1cd98-1519-411f-96dc-b09cf1483c01 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:05 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-38f1cd98-1519-411f-96dc-b09cf1483c01 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61da33cb-0e18-4f34-a653-77cd592ef9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b013853b-7a9f-437b-9bf0-cc807397fd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:05 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-38f1cd98-1519-411f-96dc-b09cf1483c01 1073741824 Sep 23 15:27:05 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:05 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Volume volume-99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832 (99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832): created successfully Sep 23 15:27:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b013853b-7a9f-437b-9bf0-cc807397fd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:05 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Flow 'volume_create_manager' (2aa729dc-ec0d-4d77-b986-2eaf989be637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:06 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-4212a787-4aa3-4a54-b081-5ba7c4f2972d tempest-CreateVolumesFromImageTest-1053775227 None] Created volume successfully. Sep 23 15:27:06 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-38f1cd98-1519-411f-96dc-b09cf1483c01 1073741824" returned: 0 in 0.559s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-38f1cd98-1519-411f-96dc-b09cf1483c01 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:06 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-38f1cd98-1519-411f-96dc-b09cf1483c01 Sep 23 15:27:06 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:06 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-38f1cd98-1519-411f-96dc-b09cf1483c01" returned: 0 in 0.313s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.225s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-405864766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc9a94de-c636-4121-a2e7-004b6df82a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6500f60cb7e74552ba4dd0c3425a658c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:03Z,use_quota=True,user_id='1feb0484ad8b4dcabfec6764142757a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Creating volume cc9a94de-c636-4121-a2e7-004b6df82a50 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:06 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cc9a94de-c636-4121-a2e7-004b6df82a50 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0765bffd-9b2d-4725-af7d-9499f7e85291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38f1cd98-1519-411f-96dc-b09cf1483c01', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef12017-2da7-4389-9f8b-93725c0a5014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:06 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cc9a94de-c636-4121-a2e7-004b6df82a50 1073741824 Sep 23 15:27:06 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:06 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Volume volume-38f1cd98-1519-411f-96dc-b09cf1483c01 (38f1cd98-1519-411f-96dc-b09cf1483c01): created successfully Sep 23 15:27:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef12017-2da7-4389-9f8b-93725c0a5014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Flow 'volume_create_manager' (106003b1-3eb1-495a-8c65-d7108f44c980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:06 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-2998310a-2b99-44ac-b93f-3216bdfe1ad9 tempest-CreateVolumesFromImageTest-1053775227 None] Created volume successfully. Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Flow 'volume_create_manager' (14e10c03-5bab-467d-9e66-9454fbafad94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d305db-724d-47d8-aa49-9b2a2f56b751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d305db-724d-47d8-aa49-9b2a2f56b751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef4fe5c-2ebb-41ab-b781-158f172e0c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e544f9e0af14f16ba51eebb9d4eb21c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:07Z,use_quota=True,user_id='eee16e2da1d645faa2d8fa7947fdbf8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25dc1102-5e36-4ddf-b563-0abbed445bb8),volume_type_id=25dc1102-5e36-4ddf-b563-0abbed445bb8)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d540edc-2589-470a-bbdd-b5d0c3b6e640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d540edc-2589-470a-bbdd-b5d0c3b6e640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b9df12-c49b-4209-b49c-9283c76c694e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG cinder.image.glance [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Creating Keystone auth plugin from conf {{(pid=86064) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 15:27:07 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cc9a94de-c636-4121-a2e7-004b6df82a50 1073741824" returned: 0 in 0.605s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cc9a94de-c636-4121-a2e7-004b6df82a50 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:07 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cc9a94de-c636-4121-a2e7-004b6df82a50 Sep 23 15:27:07 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b9df12-c49b-4209-b49c-9283c76c694e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aef4fe5c-2ebb-41ab-b781-158f172e0c8b', 'volume_name': 'volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b', 'volume_size': 1, 'image_id': '94d96123-4376-491a-ab0d-2a7ef12a097a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94d96123-4376-491a-ab0d-2a7ef12a097a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '400b52628345f2ca45403dcf2335de4d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e544f9e0af14f16ba51eebb9d4eb21c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aa5758c612157ccf2c832183d61b6443b1fa7a2f6953b851151d276601749141da0b009af5cb8979a754347e528fbe40038fcdce9b4f02460722123d748a64d3', 'id': '94d96123-4376-491a-ab0d-2a7ef12a097a', 'created_at': datetime.datetime(2026, 9, 23, 13, 27, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 27, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94d96123-4376-491a-ab0d-2a7ef12a097a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41207142-b52b-46f2-a712-d87d75320380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41207142-b52b-46f2-a712-d87d75320380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6c26244-7ef7-43ba-99c3-26cd698e8549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:07 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Volume aef4fe5c-2ebb-41ab-b781-158f172e0c8b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b', 'volume_size': 1, 'image_id': '94d96123-4376-491a-ab0d-2a7ef12a097a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94d96123-4376-491a-ab0d-2a7ef12a097a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '400b52628345f2ca45403dcf2335de4d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e544f9e0af14f16ba51eebb9d4eb21c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aa5758c612157ccf2c832183d61b6443b1fa7a2f6953b851151d276601749141da0b009af5cb8979a754347e528fbe40038fcdce9b4f02460722123d748a64d3', 'id': '94d96123-4376-491a-ab0d-2a7ef12a097a', 'created_at': datetime.datetime(2026, 9, 23, 13, 27, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 27, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94d96123-4376-491a-ab0d-2a7ef12a097a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Trying to clone aef4fe5c-2ebb-41ab-b781-158f172e0c8b from image 94d96123-4376-491a-ab0d-2a7ef12a097a at location (None, [{'url': 'file:///opt/stack/data/glance/images/94d96123-4376-491a-ab0d-2a7ef12a097a', 'metadata': {}}]). {{(pid=86064) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 15:27:07 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Image download 0.00 MB at 0.00 MB/s Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ab58df-735f-415e-a5af-9cbb05e65546]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:07 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cc9a94de-c636-4121-a2e7-004b6df82a50" returned: 0 in 0.290s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-78ea83f0-c6a8-4af9-a688-2a17f19dc75b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.346s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03dfc623-48bc-497c-bc76-135fce5eb9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc9a94de-c636-4121-a2e7-004b6df82a50', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2fcca0-3753-4b8d-89b0-46d4575b2c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-78ea83f0-c6a8-4af9-a688-2a17f19dc75b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Creating offline snapshot 002e074e-cb3f-436b-890e-a057cba2d7c6 of volume d39188bf-6cbe-4f2e-a109-53ab3e9a68fb {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:27:07 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Volume volume-cc9a94de-c636-4121-a2e7-004b6df82a50 (cc9a94de-c636-4121-a2e7-004b6df82a50): created successfully Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2fcca0-3753-4b8d-89b0-46d4575b2c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Flow 'volume_create_manager' (be92aaa4-c0e3-4596-a4f9-d3566c32eb42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[0028c737-9806-4aa6-a956-f475774e0330]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-78ea83f0-c6a8-4af9-a688-2a17f19dc75b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:07 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD Sep 23 15:27:07 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:07 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-3cc8db47-67e5-4288-8a8d-2e4f49783811 tempest-CreateVolumesFromImageTest-1053775227 None] Created volume successfully. Sep 23 15:27:08 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb Sep 23 15:27:08 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:08 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a2211985-6448-4703-9103-c1a11d39cd0d tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "cinder-cc9a94de-c636-4121-a2e7-004b6df82a50-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:08 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a2211985-6448-4703-9103-c1a11d39cd0d tempest-CreateVolumesFromImageTest-1053775227 None] Lock "cinder-cc9a94de-c636-4121-a2e7-004b6df82a50-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:08 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:08 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a2211985-6448-4703-9103-c1a11d39cd0d tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "cinder-quobyte-cc9a94de-c636-4121-a2e7-004b6df82a50" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:08 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a2211985-6448-4703-9103-c1a11d39cd0d tempest-CreateVolumesFromImageTest-1053775227 None] Lock "cinder-quobyte-cc9a94de-c636-4121-a2e7-004b6df82a50" acquired by "delete_volume" :: waited 0.021s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:08 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c8b72c-2285-4257-929f-6f32d2143522]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a2211985-6448-4703-9103-c1a11d39cd0d tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cc9a94de-c636-4121-a2e7-004b6df82a50 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:08 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-78ea83f0-c6a8-4af9-a688-2a17f19dc75b tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb" returned: 0 in 0.424s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-78ea83f0-c6a8-4af9-a688-2a17f19dc75b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.002e074e-cb3f-436b-890e-a057cba2d7c6 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:08 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD Sep 23 15:27:08 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:08 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.002e074e-cb3f-436b-890e-a057cba2d7c6 1G Sep 23 15:27:08 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:08 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cc9a94de-c636-4121-a2e7-004b6df82a50 Sep 23 15:27:08 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:08 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD" returned: 1 in 0.419s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:27:08 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Temporary image 94d96123-4376-491a-ab0d-2a7ef12a097a is fetched for user eee16e2da1d645faa2d8fa7947fdbf8b. {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 15:27:08 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[957006e8-271b-43aa-be3a-eecbddc049e0]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:08 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a2211985-6448-4703-9103-c1a11d39cd0d tempest-CreateVolumesFromImageTest-1053775227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cc9a94de-c636-4121-a2e7-004b6df82a50" returned: 0 in 0.474s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a2211985-6448-4703-9103-c1a11d39cd0d tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cc9a94de-c636-4121-a2e7-004b6df82a50 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:08 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cc9a94de-c636-4121-a2e7-004b6df82a50 Sep 23 15:27:08 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:08 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD Sep 23 15:27:08 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:08 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-78ea83f0-c6a8-4af9-a688-2a17f19dc75b tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.002e074e-cb3f-436b-890e-a057cba2d7c6 1G" returned: 0 in 0.545s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-78ea83f0-c6a8-4af9-a688-2a17f19dc75b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.002e074e-cb3f-436b-890e-a057cba2d7c6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:08 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.002e074e-cb3f-436b-890e-a057cba2d7c6 Sep 23 15:27:08 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:09 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a2211985-6448-4703-9103-c1a11d39cd0d tempest-CreateVolumesFromImageTest-1053775227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cc9a94de-c636-4121-a2e7-004b6df82a50" returned: 0 in 0.384s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:09 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD" returned: 0 in 0.455s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a2211985-6448-4703-9103-c1a11d39cd0d tempest-CreateVolumesFromImageTest-1053775227 None] Lock "cinder-quobyte-cc9a94de-c636-4121-a2e7-004b6df82a50" released by "delete_volume" :: held 0.921s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:09 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-78ea83f0-c6a8-4af9-a688-2a17f19dc75b tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.002e074e-cb3f-436b-890e-a057cba2d7c6" returned: 0 in 0.371s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:09 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-78ea83f0-c6a8-4af9-a688-2a17f19dc75b tempest-CreateVolumesFromSnapshotTest-1011635465 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.002e074e-cb3f-436b-890e-a057cba2d7c6 is being set with open permissions: ugo+rw Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-78ea83f0-c6a8-4af9-a688-2a17f19dc75b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.002e074e-cb3f-436b-890e-a057cba2d7c6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:09 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.002e074e-cb3f-436b-890e-a057cba2d7c6 Sep 23 15:27:09 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-a2211985-6448-4703-9103-c1a11d39cd0d tempest-CreateVolumesFromImageTest-1053775227 None] Created reservations ['b72c665a-2343-4876-8431-8ab40e3b9fc7', '01927a60-6a93-40c8-9afb-f421b9475c5f', '39073402-f049-47ac-83ef-9ec5aef1a850', 'c05bcdc5-7d45-4326-853c-d89bd3dc2a22'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:09 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD Sep 23 15:27:09 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a2211985-6448-4703-9103-c1a11d39cd0d tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a2211985-6448-4703-9103-c1a11d39cd0d tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a2211985-6448-4703-9103-c1a11d39cd0d tempest-CreateVolumesFromImageTest-1053775227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-a2211985-6448-4703-9103-c1a11d39cd0d tempest-CreateVolumesFromImageTest-1053775227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a2211985-6448-4703-9103-c1a11d39cd0d tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a2211985-6448-4703-9103-c1a11d39cd0d tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:09 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:09 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:09 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-78ea83f0-c6a8-4af9-a688-2a17f19dc75b tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.002e074e-cb3f-436b-890e-a057cba2d7c6" returned: 0 in 0.352s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:09 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD" returned: 1 in 0.438s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-78ea83f0-c6a8-4af9-a688-2a17f19dc75b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:09 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.info Sep 23 15:27:09 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:09 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a2211985-6448-4703-9103-c1a11d39cd0d tempest-CreateVolumesFromImageTest-1053775227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.319s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-a2211985-6448-4703-9103-c1a11d39cd0d tempest-CreateVolumesFromImageTest-1053775227 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:09 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-a2211985-6448-4703-9103-c1a11d39cd0d tempest-CreateVolumesFromImageTest-1053775227 None] Deleted volume successfully. Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a2211985-6448-4703-9103-c1a11d39cd0d tempest-CreateVolumesFromImageTest-1053775227 None] Lock "cinder-cc9a94de-c636-4121-a2e7-004b6df82a50-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:09 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-78ea83f0-c6a8-4af9-a688-2a17f19dc75b tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.info" returned: 0 in 0.308s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:09 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-78ea83f0-c6a8-4af9-a688-2a17f19dc75b tempest-CreateVolumesFromSnapshotTest-1011635465 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.info is being set with open permissions: ugo+rw Sep 23 15:27:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-78ea83f0-c6a8-4af9-a688-2a17f19dc75b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:09 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.info Sep 23 15:27:09 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:10 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-78ea83f0-c6a8-4af9-a688-2a17f19dc75b tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.info" returned: 0 in 0.259s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-78ea83f0-c6a8-4af9-a688-2a17f19dc75b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.401s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.624s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef4fe5c-2ebb-41ab-b781-158f172e0c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e544f9e0af14f16ba51eebb9d4eb21c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:07Z,use_quota=True,user_id='eee16e2da1d645faa2d8fa7947fdbf8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25dc1102-5e36-4ddf-b563-0abbed445bb8),volume_type_id=25dc1102-5e36-4ddf-b563-0abbed445bb8)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Creating volume aef4fe5c-2ebb-41ab-b781-158f172e0c8b {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:10 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:10 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b 1073741824 Sep 23 15:27:10 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:10 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-78ea83f0-c6a8-4af9-a688-2a17f19dc75b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Create snapshot completed successfully Sep 23 15:27:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bdf9f698-0f0b-4267-ab64-29ed763d496b tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "cinder-38f1cd98-1519-411f-96dc-b09cf1483c01-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bdf9f698-0f0b-4267-ab64-29ed763d496b tempest-CreateVolumesFromImageTest-1053775227 None] Lock "cinder-38f1cd98-1519-411f-96dc-b09cf1483c01-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bdf9f698-0f0b-4267-ab64-29ed763d496b tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "cinder-quobyte-38f1cd98-1519-411f-96dc-b09cf1483c01" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bdf9f698-0f0b-4267-ab64-29ed763d496b tempest-CreateVolumesFromImageTest-1053775227 None] Lock "cinder-quobyte-38f1cd98-1519-411f-96dc-b09cf1483c01" acquired by "delete_volume" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:10 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5972fbc-d8e2-481e-a977-2d9e0affa562]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bdf9f698-0f0b-4267-ab64-29ed763d496b tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-38f1cd98-1519-411f-96dc-b09cf1483c01 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:10 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-38f1cd98-1519-411f-96dc-b09cf1483c01 Sep 23 15:27:10 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:10 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b 1073741824" returned: 0 in 0.487s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:10 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b Sep 23 15:27:10 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:11 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bdf9f698-0f0b-4267-ab64-29ed763d496b tempest-CreateVolumesFromImageTest-1053775227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-38f1cd98-1519-411f-96dc-b09cf1483c01" returned: 0 in 0.475s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bdf9f698-0f0b-4267-ab64-29ed763d496b tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-38f1cd98-1519-411f-96dc-b09cf1483c01 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:11 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-38f1cd98-1519-411f-96dc-b09cf1483c01 Sep 23 15:27:11 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:11 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b" returned: 0 in 0.330s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Attempting download of 94d96123-4376-491a-ab0d-2a7ef12a097a ((None, [{'url': 'file:///opt/stack/data/glance/images/94d96123-4376-491a-ab0d-2a7ef12a097a', 'metadata': {}}])) to volume aef4fe5c-2ebb-41ab-b781-158f172e0c8b. {{(pid=86064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d8ad34-27ab-4b74-b5f1-c8ae0dbfe7ba]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94d96123-4376-491a-ab0d-2a7ef12a097a_g6uizyi2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:11 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Flow 'volume_create_manager' (e26d6993-c485-42c8-b693-0e8d8bc067e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec1550c-ba3d-468d-8014-e8f5c67e121e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:11 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94d96123-4376-491a-ab0d-2a7ef12a097a_g6uizyi2 Sep 23 15:27:11 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bdf9f698-0f0b-4267-ab64-29ed763d496b tempest-CreateVolumesFromImageTest-1053775227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-38f1cd98-1519-411f-96dc-b09cf1483c01" returned: 0 in 0.443s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec1550c-ba3d-468d-8014-e8f5c67e121e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1164921052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050f744a9cf348d6a433f5deee9438b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:11Z,use_quota=True,user_id='8362b0639f364e3fbd9eff55f1e4a680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae49849a-e06e-4663-ae7b-0e255dc9bcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae49849a-e06e-4663-ae7b-0e255dc9bcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68ffbf1-1a21-40e7-bcf1-05d13faeb5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68ffbf1-1a21-40e7-bcf1-05d13faeb5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf', 'volume_name': 'volume-6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a649b4-421d-4df6-9b8f-008b1256ec03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a649b4-421d-4df6-9b8f-008b1256ec03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (913b097a-ba57-4d0a-90e5-23833f16fb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:11 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Volume 6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf', 'volume_size': 1} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1164921052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050f744a9cf348d6a433f5deee9438b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:11Z,use_quota=True,user_id='8362b0639f364e3fbd9eff55f1e4a680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Creating volume 6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:11 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bdf9f698-0f0b-4267-ab64-29ed763d496b tempest-CreateVolumesFromImageTest-1053775227 None] Lock "cinder-quobyte-38f1cd98-1519-411f-96dc-b09cf1483c01" released by "delete_volume" :: held 1.056s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:11 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf 1073741824 Sep 23 15:27:11 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-bdf9f698-0f0b-4267-ab64-29ed763d496b tempest-CreateVolumesFromImageTest-1053775227 None] Created reservations ['ba47efb6-54b4-4c9c-a11e-6c8a28f6bbf0', '412129c7-d0e9-49e5-9838-2c12fb720c2e', 'a5486c80-cbd3-476c-94fc-fc51c0fcebb9', '8b997777-db67-461e-b6a3-14d513e2fd7a'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:11 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94d96123-4376-491a-ab0d-2a7ef12a097a_g6uizyi2" returned: 0 in 0.539s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d96123-4376-491a-ab0d-2a7ef12a097a_g6uizyi2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bdf9f698-0f0b-4267-ab64-29ed763d496b tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bdf9f698-0f0b-4267-ab64-29ed763d496b tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bdf9f698-0f0b-4267-ab64-29ed763d496b tempest-CreateVolumesFromImageTest-1053775227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bdf9f698-0f0b-4267-ab64-29ed763d496b tempest-CreateVolumesFromImageTest-1053775227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bdf9f698-0f0b-4267-ab64-29ed763d496b tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bdf9f698-0f0b-4267-ab64-29ed763d496b tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:11 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:11 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:12 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d96123-4376-491a-ab0d-2a7ef12a097a_g6uizyi2 Sep 23 15:27:12 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:12 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf 1073741824" returned: 0 in 0.783s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:12 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:12 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d96123-4376-491a-ab0d-2a7ef12a097a_g6uizyi2" returned: 1 in 0.570s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d96123-4376-491a-ab0d-2a7ef12a097a_g6uizyi2' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bdf9f698-0f0b-4267-ab64-29ed763d496b tempest-CreateVolumesFromImageTest-1053775227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.505s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8eb79ea-a2cb-4993-b6ae-ca74edd46ddd]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-bdf9f698-0f0b-4267-ab64-29ed763d496b tempest-CreateVolumesFromImageTest-1053775227 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:12 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-bdf9f698-0f0b-4267-ab64-29ed763d496b tempest-CreateVolumesFromImageTest-1053775227 None] Deleted volume successfully. Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bdf9f698-0f0b-4267-ab64-29ed763d496b tempest-CreateVolumesFromImageTest-1053775227 None] Lock "cinder-38f1cd98-1519-411f-96dc-b09cf1483c01-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:12 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf Sep 23 15:27:12 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:12 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD Sep 23 15:27:12 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Flow 'volume_create_manager' (379cecaf-4c89-4375-99a0-76f0f37db5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e026b79d-4c00-48ad-bf7b-c022199b62bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:12 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e026b79d-4c00-48ad-bf7b-c022199b62bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640900428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4639cc-937b-4bf8-93bd-524355dfccb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050f744a9cf348d6a433f5deee9438b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:13Z,use_quota=True,user_id='8362b0639f364e3fbd9eff55f1e4a680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade2397b-b94e-4111-8c66-597506539ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade2397b-b94e-4111-8c66-597506539ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0ed6a7-991f-44f1-85ba-fa42f98138e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0ed6a7-991f-44f1-85ba-fa42f98138e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee4639cc-937b-4bf8-93bd-524355dfccb2', 'volume_name': 'volume-ee4639cc-937b-4bf8-93bd-524355dfccb2', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2526e16-8e86-4bd0-a9fc-b06102501c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2526e16-8e86-4bd0-a9fc-b06102501c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118d585d-2de2-4bcb-92ef-d8ff7679d28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:12 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Volume ee4639cc-937b-4bf8-93bd-524355dfccb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee4639cc-937b-4bf8-93bd-524355dfccb2', 'volume_size': 1} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf" returned: 0 in 0.435s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640900428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4639cc-937b-4bf8-93bd-524355dfccb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050f744a9cf348d6a433f5deee9438b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:13Z,use_quota=True,user_id='8362b0639f364e3fbd9eff55f1e4a680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:12 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Creating volume ee4639cc-937b-4bf8-93bd-524355dfccb2 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:12 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ee4639cc-937b-4bf8-93bd-524355dfccb2 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:12 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ee4639cc-937b-4bf8-93bd-524355dfccb2 1073741824 Sep 23 15:27:12 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Flow 'volume_create_manager' (cea75e9b-8bcb-44dc-b125-5db9cf40c9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd11ed9-0f5a-48aa-9327-62c8cd98faee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD" returned: 0 in 0.571s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-54b6a68b-1a4e-4173-a29d-d24ea58319fe tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "cinder-99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (913b097a-ba57-4d0a-90e5-23833f16fb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9a93d6-0992-4054-8fbb-ee418f542a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd11ed9-0f5a-48aa-9327-62c8cd98faee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-677957460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a20ee897-a96c-44cd-9d1c-51ec18140945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050f744a9cf348d6a433f5deee9438b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:13Z,use_quota=True,user_id='8362b0639f364e3fbd9eff55f1e4a680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe52bdf-1d1c-4365-a0ae-0cf0e9a87184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe52bdf-1d1c-4365-a0ae-0cf0e9a87184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10390df-a977-4ce3-88cc-82a0d1c16093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10390df-a977-4ce3-88cc-82a0d1c16093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a20ee897-a96c-44cd-9d1c-51ec18140945', 'volume_name': 'volume-a20ee897-a96c-44cd-9d1c-51ec18140945', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:13 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7507e9-2aa2-4069-8815-029772f7d5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:13 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7507e9-2aa2-4069-8815-029772f7d5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9efe9c4-2864-4694-a0a9-5ff36b97110a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:13 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Volume a20ee897-a96c-44cd-9d1c-51ec18140945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a20ee897-a96c-44cd-9d1c-51ec18140945', 'volume_size': 1} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-54b6a68b-1a4e-4173-a29d-d24ea58319fe tempest-CreateVolumesFromImageTest-1053775227 None] Lock "cinder-99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832-delete_volume" acquired by "delete_volume" :: waited 0.233s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:13 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Volume volume-6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf (6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf): created successfully Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9a93d6-0992-4054-8fbb-ee418f542a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Flow 'volume_create_manager' (e26d6993-c485-42c8-b693-0e8d8bc067e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:13 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-dd5f3c54-8e3c-4008-9f0e-d86d49a4dd05 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Created volume successfully. Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Flow 'volume_create_manager' (de661296-a5dc-4939-911d-ba8c8553b801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04b76f0-d692-4ede-86e6-89f9fdbf2213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04b76f0-d692-4ede-86e6-89f9fdbf2213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1380442746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44f7e110-9d11-4dc4-8aad-40b33c2c94b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050f744a9cf348d6a433f5deee9438b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:13Z,use_quota=True,user_id='8362b0639f364e3fbd9eff55f1e4a680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78d8bfe-d11e-47fb-a65d-fc7c1d063067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78d8bfe-d11e-47fb-a65d-fc7c1d063067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6916228e-b299-41a7-88c5-503b4b9cd4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6916228e-b299-41a7-88c5-503b4b9cd4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44f7e110-9d11-4dc4-8aad-40b33c2c94b9', 'volume_name': 'volume-44f7e110-9d11-4dc4-8aad-40b33c2c94b9', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9d8ea2-78c9-4303-b5e7-d62ed8a0ebb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9d8ea2-78c9-4303-b5e7-d62ed8a0ebb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f3f71e3-5d98-437b-8dc4-2d54d3aa2a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:13 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Volume 44f7e110-9d11-4dc4-8aad-40b33c2c94b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44f7e110-9d11-4dc4-8aad-40b33c2c94b9', 'volume_size': 1} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-54b6a68b-1a4e-4173-a29d-d24ea58319fe tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "cinder-quobyte-99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:13 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-54b6a68b-1a4e-4173-a29d-d24ea58319fe tempest-CreateVolumesFromImageTest-1053775227 None] Lock "cinder-quobyte-99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832" acquired by "delete_volume" :: waited 0.024s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD" returned: 1 in 0.626s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] 94d96123-4376-491a-ab0d-2a7ef12a097a was raw, converting to qcow2 {{(pid=86064) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71652af-1406-4ed6-b2ef-afa778b4f560]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-54b6a68b-1a4e-4173-a29d-d24ea58319fe tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:13 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b Sep 23 15:27:13 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Flow 'volume_create_manager' (988950f7-b1d6-4a75-9ed8-e7f949b51179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de027cf-ad81-42bb-b716-2193899f577d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de027cf-ad81-42bb-b716-2193899f577d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-317563611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f297d36-2cfc-466f-8da8-0beb5fb2c8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050f744a9cf348d6a433f5deee9438b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:14Z,use_quota=True,user_id='8362b0639f364e3fbd9eff55f1e4a680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977074b9-3d21-4c4b-8802-245205c42673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977074b9-3d21-4c4b-8802-245205c42673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ebc34ff-9b79-421f-9ce4-751aad1ab2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ebc34ff-9b79-421f-9ce4-751aad1ab2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f297d36-2cfc-466f-8da8-0beb5fb2c8c3', 'volume_name': 'volume-6f297d36-2cfc-466f-8da8-0beb5fb2c8c3', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09cd712-a195-4539-b555-26975bb97351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09cd712-a195-4539-b555-26975bb97351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21977519-c4a0-41a0-8d97-3d3b80e5e4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:13 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Volume 6f297d36-2cfc-466f-8da8-0beb5fb2c8c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f297d36-2cfc-466f-8da8-0beb5fb2c8c3', 'volume_size': 1} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:13 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ee4639cc-937b-4bf8-93bd-524355dfccb2 1073741824" returned: 0 in 0.910s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ee4639cc-937b-4bf8-93bd-524355dfccb2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:13 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832 Sep 23 15:27:13 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:13 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ee4639cc-937b-4bf8-93bd-524355dfccb2 Sep 23 15:27:13 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:14 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ee4639cc-937b-4bf8-93bd-524355dfccb2" returned: 0 in 0.313s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.934s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-677957460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a20ee897-a96c-44cd-9d1c-51ec18140945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050f744a9cf348d6a433f5deee9438b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:13Z,use_quota=True,user_id='8362b0639f364e3fbd9eff55f1e4a680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Creating volume a20ee897-a96c-44cd-9d1c-51ec18140945 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:14 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a20ee897-a96c-44cd-9d1c-51ec18140945 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118d585d-2de2-4bcb-92ef-d8ff7679d28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee4639cc-937b-4bf8-93bd-524355dfccb2', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:14 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a20ee897-a96c-44cd-9d1c-51ec18140945 1073741824 Sep 23 15:27:14 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deda8c9e-b95f-414e-bf39-cbb60c4409a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:14 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:14 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:14 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Volume volume-ee4639cc-937b-4bf8-93bd-524355dfccb2 (ee4639cc-937b-4bf8-93bd-524355dfccb2): created successfully Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deda8c9e-b95f-414e-bf39-cbb60c4409a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Flow 'volume_create_manager' (379cecaf-4c89-4375-99a0-76f0f37db5f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b" returned: 0 in 0.638s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_94d96123-4376-491a-ab0d-2a7ef12a097a_lbfyx8dpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:27:14 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-54b6a68b-1a4e-4173-a29d-d24ea58319fe tempest-CreateVolumesFromImageTest-1053775227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832" returned: 0 in 0.620s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-54b6a68b-1a4e-4173-a29d-d24ea58319fe tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:14 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-33efb2c6-82c5-4847-8850-c7f9660da0fe tempest-CreateVolumesFromSnapshotTest-1011635465 None] Created volume successfully. Sep 23 15:27:14 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b 1G Sep 23 15:27:14 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:14 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832 Sep 23 15:27:14 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:14 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-54b6a68b-1a4e-4173-a29d-d24ea58319fe tempest-CreateVolumesFromImageTest-1053775227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832" returned: 0 in 0.330s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-54b6a68b-1a4e-4173-a29d-d24ea58319fe tempest-CreateVolumesFromImageTest-1053775227 None] Lock "cinder-quobyte-99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832" released by "delete_volume" :: held 1.043s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-54b6a68b-1a4e-4173-a29d-d24ea58319fe tempest-CreateVolumesFromImageTest-1053775227 None] Created reservations ['a7b3667f-900b-46c8-afbf-0944084c7c1e', 'd66a7764-216b-425e-ac1e-fd76ba1da42d', '2a73571b-435c-4e71-95c1-7fdf98b7e145', 'b8f9d040-2dba-4101-a72e-a13b7e749727'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:14 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:14 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a20ee897-a96c-44cd-9d1c-51ec18140945 1073741824" returned: 0 in 0.588s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b 1G" returned: 0 in 0.511s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Downloaded image 94d96123-4376-491a-ab0d-2a7ef12a097a ((None, [{'url': 'file:///opt/stack/data/glance/images/94d96123-4376-491a-ab0d-2a7ef12a097a', 'metadata': {}}])) to volume aef4fe5c-2ebb-41ab-b781-158f172e0c8b successfully. {{(pid=86064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Temporary image 94d96123-4376-491a-ab0d-2a7ef12a097a for user eee16e2da1d645faa2d8fa7947fdbf8b is deleted. {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Marking volume aef4fe5c-2ebb-41ab-b781-158f172e0c8b as bootable. {{(pid=86064) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Copying metadata from image 94d96123-4376-491a-ab0d-2a7ef12a097a to aef4fe5c-2ebb-41ab-b781-158f172e0c8b. {{(pid=86064) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Creating volume glance metadata for volume aef4fe5c-2ebb-41ab-b781-158f172e0c8b backed by image 94d96123-4376-491a-ab0d-2a7ef12a097a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '94d96123-4376-491a-ab0d-2a7ef12a097a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '400b52628345f2ca45403dcf2335de4d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86064) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-54b6a68b-1a4e-4173-a29d-d24ea58319fe tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-54b6a68b-1a4e-4173-a29d-d24ea58319fe tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-54b6a68b-1a4e-4173-a29d-d24ea58319fe tempest-CreateVolumesFromImageTest-1053775227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-54b6a68b-1a4e-4173-a29d-d24ea58319fe tempest-CreateVolumesFromImageTest-1053775227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-54b6a68b-1a4e-4173-a29d-d24ea58319fe tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-54b6a68b-1a4e-4173-a29d-d24ea58319fe tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a20ee897-a96c-44cd-9d1c-51ec18140945 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:14 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:14 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:14 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a20ee897-a96c-44cd-9d1c-51ec18140945 Sep 23 15:27:14 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6c26244-7ef7-43ba-99c3-26cd698e8549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b', 'volume_size': 1, 'image_id': '94d96123-4376-491a-ab0d-2a7ef12a097a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94d96123-4376-491a-ab0d-2a7ef12a097a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '400b52628345f2ca45403dcf2335de4d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e544f9e0af14f16ba51eebb9d4eb21c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aa5758c612157ccf2c832183d61b6443b1fa7a2f6953b851151d276601749141da0b009af5cb8979a754347e528fbe40038fcdce9b4f02460722123d748a64d3', 'id': '94d96123-4376-491a-ab0d-2a7ef12a097a', 'created_at': datetime.datetime(2026, 9, 23, 13, 27, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 27, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94d96123-4376-491a-ab0d-2a7ef12a097a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd3c5d57-73b3-4d80-8c07-9508e5fefb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:15 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Volume volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b (aef4fe5c-2ebb-41ab-b781-158f172e0c8b): created successfully Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd3c5d57-73b3-4d80-8c07-9508e5fefb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Flow 'volume_create_manager' (14e10c03-5bab-467d-9e66-9454fbafad94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:15 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-624f20b0-9583-432f-9707-760bdea2a2b1 tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Created volume successfully. Sep 23 15:27:15 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:15 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a20ee897-a96c-44cd-9d1c-51ec18140945" returned: 0 in 0.341s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-54b6a68b-1a4e-4173-a29d-d24ea58319fe tempest-CreateVolumesFromImageTest-1053775227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.371s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-54b6a68b-1a4e-4173-a29d-d24ea58319fe tempest-CreateVolumesFromImageTest-1053775227 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.652s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1380442746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44f7e110-9d11-4dc4-8aad-40b33c2c94b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050f744a9cf348d6a433f5deee9438b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:13Z,use_quota=True,user_id='8362b0639f364e3fbd9eff55f1e4a680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Creating volume 44f7e110-9d11-4dc4-8aad-40b33c2c94b9 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:15 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-44f7e110-9d11-4dc4-8aad-40b33c2c94b9 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:15 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-54b6a68b-1a4e-4173-a29d-d24ea58319fe tempest-CreateVolumesFromImageTest-1053775227 None] Deleted volume successfully. Sep 23 15:27:15 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-44f7e110-9d11-4dc4-8aad-40b33c2c94b9 1073741824 Sep 23 15:27:15 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9efe9c4-2864-4694-a0a9-5ff36b97110a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a20ee897-a96c-44cd-9d1c-51ec18140945', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89aab5a-d085-40d4-b02c-beb07fd84da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:15 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Volume volume-a20ee897-a96c-44cd-9d1c-51ec18140945 (a20ee897-a96c-44cd-9d1c-51ec18140945): created successfully Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89aab5a-d085-40d4-b02c-beb07fd84da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Flow 'volume_create_manager' (cea75e9b-8bcb-44dc-b125-5db9cf40c9aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-54b6a68b-1a4e-4173-a29d-d24ea58319fe tempest-CreateVolumesFromImageTest-1053775227 None] Lock "cinder-99e8b754-cd4a-4c1c-b9ed-0a79b7c9e832-delete_volume" released by "delete_volume" :: held 2.075s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2e625213-d7b7-4df3-96d4-abfb474bbf15 tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "cinder-2799bec1-67e6-4f6b-bb9e-e9e51d26148e-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:15 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-c555c1c2-b8a3-463a-9971-b90ab09841b1 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Created volume successfully. Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2e625213-d7b7-4df3-96d4-abfb474bbf15 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "cinder-2799bec1-67e6-4f6b-bb9e-e9e51d26148e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2e625213-d7b7-4df3-96d4-abfb474bbf15 tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "cinder-quobyte-2799bec1-67e6-4f6b-bb9e-e9e51d26148e" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2e625213-d7b7-4df3-96d4-abfb474bbf15 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "cinder-quobyte-2799bec1-67e6-4f6b-bb9e-e9e51d26148e" acquired by "delete_volume" :: waited 0.019s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca108ed-3fb8-4412-bfb1-9a7215d22292]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2e625213-d7b7-4df3-96d4-abfb474bbf15 tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2799bec1-67e6-4f6b-bb9e-e9e51d26148e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:15 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2799bec1-67e6-4f6b-bb9e-e9e51d26148e Sep 23 15:27:15 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7bdfc08b-c9cd-4717-80de-0e9e3b67bd9e tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Acquiring lock "cinder-aef4fe5c-2ebb-41ab-b781-158f172e0c8b-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:15 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-44f7e110-9d11-4dc4-8aad-40b33c2c94b9 1073741824" returned: 0 in 0.585s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7bdfc08b-c9cd-4717-80de-0e9e3b67bd9e tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Lock "cinder-aef4fe5c-2ebb-41ab-b781-158f172e0c8b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-44f7e110-9d11-4dc4-8aad-40b33c2c94b9 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7bdfc08b-c9cd-4717-80de-0e9e3b67bd9e tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Acquiring lock "cinder-quobyte-aef4fe5c-2ebb-41ab-b781-158f172e0c8b" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:15 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-44f7e110-9d11-4dc4-8aad-40b33c2c94b9 Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7bdfc08b-c9cd-4717-80de-0e9e3b67bd9e tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Lock "cinder-quobyte-aef4fe5c-2ebb-41ab-b781-158f172e0c8b" acquired by "delete_volume" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:15 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09ec0bf-5d9c-4d87-a9fa-f68fdef86e17]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7bdfc08b-c9cd-4717-80de-0e9e3b67bd9e tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:16 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2e625213-d7b7-4df3-96d4-abfb474bbf15 tempest-CreateVolumesFromImageTest-1053775227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2799bec1-67e6-4f6b-bb9e-e9e51d26148e" returned: 0 in 0.577s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2e625213-d7b7-4df3-96d4-abfb474bbf15 tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2799bec1-67e6-4f6b-bb9e-e9e51d26148e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:16 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2799bec1-67e6-4f6b-bb9e-e9e51d26148e Sep 23 15:27:16 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:16 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b Sep 23 15:27:16 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:16 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-44f7e110-9d11-4dc4-8aad-40b33c2c94b9" returned: 0 in 0.357s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.450s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-317563611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f297d36-2cfc-466f-8da8-0beb5fb2c8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050f744a9cf348d6a433f5deee9438b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:14Z,use_quota=True,user_id='8362b0639f364e3fbd9eff55f1e4a680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Creating volume 6f297d36-2cfc-466f-8da8-0beb5fb2c8c3 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:16 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6f297d36-2cfc-466f-8da8-0beb5fb2c8c3 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:16 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6f297d36-2cfc-466f-8da8-0beb5fb2c8c3 1073741824 Sep 23 15:27:16 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f3f71e3-5d98-437b-8dc4-2d54d3aa2a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44f7e110-9d11-4dc4-8aad-40b33c2c94b9', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090dd26c-2318-4128-bbc0-de55fbd1e073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:16 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Volume volume-44f7e110-9d11-4dc4-8aad-40b33c2c94b9 (44f7e110-9d11-4dc4-8aad-40b33c2c94b9): created successfully Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090dd26c-2318-4128-bbc0-de55fbd1e073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Flow 'volume_create_manager' (de661296-a5dc-4939-911d-ba8c8553b801) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:16 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:16 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-58db34ab-2684-49fc-80c3-aa34edef23c3 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Created volume successfully. Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2e625213-d7b7-4df3-96d4-abfb474bbf15 tempest-CreateVolumesFromImageTest-1053775227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2799bec1-67e6-4f6b-bb9e-e9e51d26148e" returned: 0 in 0.366s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2e625213-d7b7-4df3-96d4-abfb474bbf15 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "cinder-quobyte-2799bec1-67e6-4f6b-bb9e-e9e51d26148e" released by "delete_volume" :: held 0.994s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:16 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7bdfc08b-c9cd-4717-80de-0e9e3b67bd9e tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b" returned: 0 in 0.455s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7bdfc08b-c9cd-4717-80de-0e9e3b67bd9e tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:16 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b Sep 23 15:27:16 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-2e625213-d7b7-4df3-96d4-abfb474bbf15 tempest-CreateVolumesFromImageTest-1053775227 None] Created reservations ['5c6c8642-f793-452d-bcc6-35394771192e', 'd679200e-7a03-4d03-b55e-df7b9b59f8ee', 'ea00d5a6-8782-4bd3-9a36-238d378a16ec', '3b601901-9cee-44f1-b863-79bfa5fd95df'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2e625213-d7b7-4df3-96d4-abfb474bbf15 tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2e625213-d7b7-4df3-96d4-abfb474bbf15 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2e625213-d7b7-4df3-96d4-abfb474bbf15 tempest-CreateVolumesFromImageTest-1053775227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2e625213-d7b7-4df3-96d4-abfb474bbf15 tempest-CreateVolumesFromImageTest-1053775227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2e625213-d7b7-4df3-96d4-abfb474bbf15 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2e625213-d7b7-4df3-96d4-abfb474bbf15 tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:16 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:16 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:16 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:16 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7bdfc08b-c9cd-4717-80de-0e9e3b67bd9e tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-aef4fe5c-2ebb-41ab-b781-158f172e0c8b" returned: 0 in 0.387s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6f297d36-2cfc-466f-8da8-0beb5fb2c8c3 1073741824" returned: 0 in 0.580s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7bdfc08b-c9cd-4717-80de-0e9e3b67bd9e tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Lock "cinder-quobyte-aef4fe5c-2ebb-41ab-b781-158f172e0c8b" released by "delete_volume" :: held 0.926s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6f297d36-2cfc-466f-8da8-0beb5fb2c8c3 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:16 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2e625213-d7b7-4df3-96d4-abfb474bbf15 tempest-CreateVolumesFromImageTest-1053775227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.317s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-2e625213-d7b7-4df3-96d4-abfb474bbf15 tempest-CreateVolumesFromImageTest-1053775227 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:16 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-2e625213-d7b7-4df3-96d4-abfb474bbf15 tempest-CreateVolumesFromImageTest-1053775227 None] Deleted volume successfully. Sep 23 15:27:16 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6f297d36-2cfc-466f-8da8-0beb5fb2c8c3 Sep 23 15:27:16 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-7bdfc08b-c9cd-4717-80de-0e9e3b67bd9e tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Created reservations ['f36450f9-41f5-42ac-870d-4bc32a03d10b', 'd167e79c-09c8-4cc0-b430-b6d6e1ba1aae', '398cacd4-e31a-4371-bc0c-f87860ebfb59', '45b8303c-1585-4a17-8e90-e014e12a2cf6'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2e625213-d7b7-4df3-96d4-abfb474bbf15 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "cinder-2799bec1-67e6-4f6b-bb9e-e9e51d26148e-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7bdfc08b-c9cd-4717-80de-0e9e3b67bd9e tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7bdfc08b-c9cd-4717-80de-0e9e3b67bd9e tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7bdfc08b-c9cd-4717-80de-0e9e3b67bd9e tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7bdfc08b-c9cd-4717-80de-0e9e3b67bd9e tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7bdfc08b-c9cd-4717-80de-0e9e3b67bd9e tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7bdfc08b-c9cd-4717-80de-0e9e3b67bd9e tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:17 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:17 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:17 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6f297d36-2cfc-466f-8da8-0beb5fb2c8c3" returned: 0 in 0.350s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21977519-c4a0-41a0-8d97-3d3b80e5e4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f297d36-2cfc-466f-8da8-0beb5fb2c8c3', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1efaec06-1708-4d89-9ed0-0d7cd4deae36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:17 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Volume volume-6f297d36-2cfc-466f-8da8-0beb5fb2c8c3 (6f297d36-2cfc-466f-8da8-0beb5fb2c8c3): created successfully Sep 23 15:27:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1efaec06-1708-4d89-9ed0-0d7cd4deae36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Flow 'volume_create_manager' (988950f7-b1d6-4a75-9ed8-e7f949b51179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:17 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7847ebd7-65bb-46a7-b054-8e4f0539a7e0 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Created volume successfully. Sep 23 15:27:17 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7bdfc08b-c9cd-4717-80de-0e9e3b67bd9e tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.300s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:17 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-7bdfc08b-c9cd-4717-80de-0e9e3b67bd9e tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:17 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7bdfc08b-c9cd-4717-80de-0e9e3b67bd9e tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Deleted volume successfully. Sep 23 15:27:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7bdfc08b-c9cd-4717-80de-0e9e3b67bd9e tempest-VolumeAndVolumeTypeFromImageTest-1622376437 None] Lock "cinder-aef4fe5c-2ebb-41ab-b781-158f172e0c8b-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c31081b3-f7b3-4fb6-ae64-9fbafec09255 tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "cinder-bbcf3690-8340-420d-89fb-ef77138e587b-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c31081b3-f7b3-4fb6-ae64-9fbafec09255 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "cinder-bbcf3690-8340-420d-89fb-ef77138e587b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c31081b3-f7b3-4fb6-ae64-9fbafec09255 tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "cinder-quobyte-bbcf3690-8340-420d-89fb-ef77138e587b" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c31081b3-f7b3-4fb6-ae64-9fbafec09255 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "cinder-quobyte-bbcf3690-8340-420d-89fb-ef77138e587b" acquired by "delete_volume" :: waited 0.022s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:17 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4317e1b3-9d3d-41fd-a48a-4e564c022453]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c31081b3-f7b3-4fb6-ae64-9fbafec09255 tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bbcf3690-8340-420d-89fb-ef77138e587b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:17 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bbcf3690-8340-420d-89fb-ef77138e587b Sep 23 15:27:17 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:18 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c31081b3-f7b3-4fb6-ae64-9fbafec09255 tempest-CreateVolumesFromImageTest-1053775227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bbcf3690-8340-420d-89fb-ef77138e587b" returned: 0 in 0.400s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c31081b3-f7b3-4fb6-ae64-9fbafec09255 tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bbcf3690-8340-420d-89fb-ef77138e587b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:18 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bbcf3690-8340-420d-89fb-ef77138e587b Sep 23 15:27:18 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0400c7f4-caca-4cae-9d77-a1cf9efeaef2 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "cinder-6f297d36-2cfc-466f-8da8-0beb5fb2c8c3-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0400c7f4-caca-4cae-9d77-a1cf9efeaef2 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-6f297d36-2cfc-466f-8da8-0beb5fb2c8c3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:18 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c31081b3-f7b3-4fb6-ae64-9fbafec09255 tempest-CreateVolumesFromImageTest-1053775227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bbcf3690-8340-420d-89fb-ef77138e587b" returned: 0 in 0.325s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c31081b3-f7b3-4fb6-ae64-9fbafec09255 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "cinder-quobyte-bbcf3690-8340-420d-89fb-ef77138e587b" released by "delete_volume" :: held 0.789s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0400c7f4-caca-4cae-9d77-a1cf9efeaef2 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "cinder-quobyte-6f297d36-2cfc-466f-8da8-0beb5fb2c8c3" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0400c7f4-caca-4cae-9d77-a1cf9efeaef2 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-quobyte-6f297d36-2cfc-466f-8da8-0beb5fb2c8c3" acquired by "delete_volume" :: waited 0.044s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:18 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-c31081b3-f7b3-4fb6-ae64-9fbafec09255 tempest-CreateVolumesFromImageTest-1053775227 None] Created reservations ['ff6647f5-b798-450a-9b89-5f0bb054ff3f', '571b9668-dd45-46cf-b188-ca2c48d5442c', '3eb0d63b-cf45-4068-8f70-c6fff368fc16', 'f445a6f0-2e32-42a4-8fc7-21ec905a110d'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:18 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0528cab-a0d6-4fe6-ae4a-e21c491f581a]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0400c7f4-caca-4cae-9d77-a1cf9efeaef2 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6f297d36-2cfc-466f-8da8-0beb5fb2c8c3 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c31081b3-f7b3-4fb6-ae64-9fbafec09255 tempest-CreateVolumesFromImageTest-1053775227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c31081b3-f7b3-4fb6-ae64-9fbafec09255 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c31081b3-f7b3-4fb6-ae64-9fbafec09255 tempest-CreateVolumesFromImageTest-1053775227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c31081b3-f7b3-4fb6-ae64-9fbafec09255 tempest-CreateVolumesFromImageTest-1053775227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c31081b3-f7b3-4fb6-ae64-9fbafec09255 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c31081b3-f7b3-4fb6-ae64-9fbafec09255 tempest-CreateVolumesFromImageTest-1053775227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:18 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:18 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6f297d36-2cfc-466f-8da8-0beb5fb2c8c3 Sep 23 15:27:18 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:18 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:19 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c31081b3-f7b3-4fb6-ae64-9fbafec09255 tempest-CreateVolumesFromImageTest-1053775227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.327s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:19 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-c31081b3-f7b3-4fb6-ae64-9fbafec09255 tempest-CreateVolumesFromImageTest-1053775227 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:19 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-c31081b3-f7b3-4fb6-ae64-9fbafec09255 tempest-CreateVolumesFromImageTest-1053775227 None] Deleted volume successfully. Sep 23 15:27:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c31081b3-f7b3-4fb6-ae64-9fbafec09255 tempest-CreateVolumesFromImageTest-1053775227 None] Lock "cinder-bbcf3690-8340-420d-89fb-ef77138e587b-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:19 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0400c7f4-caca-4cae-9d77-a1cf9efeaef2 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6f297d36-2cfc-466f-8da8-0beb5fb2c8c3" returned: 0 in 0.489s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0400c7f4-caca-4cae-9d77-a1cf9efeaef2 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6f297d36-2cfc-466f-8da8-0beb5fb2c8c3 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:19 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6f297d36-2cfc-466f-8da8-0beb5fb2c8c3 Sep 23 15:27:19 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:19 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0400c7f4-caca-4cae-9d77-a1cf9efeaef2 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6f297d36-2cfc-466f-8da8-0beb5fb2c8c3" returned: 0 in 0.289s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0400c7f4-caca-4cae-9d77-a1cf9efeaef2 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-quobyte-6f297d36-2cfc-466f-8da8-0beb5fb2c8c3" released by "delete_volume" :: held 0.871s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:19 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-0400c7f4-caca-4cae-9d77-a1cf9efeaef2 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Created reservations ['7c865c99-f1c3-40b3-a668-c766d6e84617', '0af60e60-46b3-43f2-953a-6d03993d8964', '834a443e-5cea-429e-a4e5-f1c6019d454c', 'd07d5f82-e6bf-4dca-9c27-8d021eb5f852'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0400c7f4-caca-4cae-9d77-a1cf9efeaef2 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0400c7f4-caca-4cae-9d77-a1cf9efeaef2 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0400c7f4-caca-4cae-9d77-a1cf9efeaef2 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0400c7f4-caca-4cae-9d77-a1cf9efeaef2 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0400c7f4-caca-4cae-9d77-a1cf9efeaef2 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0400c7f4-caca-4cae-9d77-a1cf9efeaef2 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:19 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:19 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cc3998ef-253c-4a61-a65a-962dcd96961b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "cinder-44f7e110-9d11-4dc4-8aad-40b33c2c94b9-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cc3998ef-253c-4a61-a65a-962dcd96961b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-44f7e110-9d11-4dc4-8aad-40b33c2c94b9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cc3998ef-253c-4a61-a65a-962dcd96961b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "cinder-quobyte-44f7e110-9d11-4dc4-8aad-40b33c2c94b9" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cc3998ef-253c-4a61-a65a-962dcd96961b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-quobyte-44f7e110-9d11-4dc4-8aad-40b33c2c94b9" acquired by "delete_volume" :: waited 0.029s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:19 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0d1819-0461-4fe7-9797-24af76074d24]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cc3998ef-253c-4a61-a65a-962dcd96961b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-44f7e110-9d11-4dc4-8aad-40b33c2c94b9 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:20 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0400c7f4-caca-4cae-9d77-a1cf9efeaef2 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.497s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:20 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-0400c7f4-caca-4cae-9d77-a1cf9efeaef2 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:20 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-0400c7f4-caca-4cae-9d77-a1cf9efeaef2 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Deleted volume successfully. Sep 23 15:27:20 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-44f7e110-9d11-4dc4-8aad-40b33c2c94b9 Sep 23 15:27:20 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-0400c7f4-caca-4cae-9d77-a1cf9efeaef2 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-6f297d36-2cfc-466f-8da8-0beb5fb2c8c3-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:20 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cc3998ef-253c-4a61-a65a-962dcd96961b tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-44f7e110-9d11-4dc4-8aad-40b33c2c94b9" returned: 0 in 0.491s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cc3998ef-253c-4a61-a65a-962dcd96961b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-44f7e110-9d11-4dc4-8aad-40b33c2c94b9 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:20 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-44f7e110-9d11-4dc4-8aad-40b33c2c94b9 Sep 23 15:27:20 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:20 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cc3998ef-253c-4a61-a65a-962dcd96961b tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-44f7e110-9d11-4dc4-8aad-40b33c2c94b9" returned: 0 in 0.451s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cc3998ef-253c-4a61-a65a-962dcd96961b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-quobyte-44f7e110-9d11-4dc4-8aad-40b33c2c94b9" released by "delete_volume" :: held 1.019s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:20 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-cc3998ef-253c-4a61-a65a-962dcd96961b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Created reservations ['2fa677f3-0465-4a17-befe-be17acb7d3ad', '4f2b39fc-0719-4869-9634-71061f1f0bec', '18ff6fb7-a931-4647-8e95-66bd3297228e', 'dbbfc645-f11a-4f61-b615-2697e085e257'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cc3998ef-253c-4a61-a65a-962dcd96961b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cc3998ef-253c-4a61-a65a-962dcd96961b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cc3998ef-253c-4a61-a65a-962dcd96961b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cc3998ef-253c-4a61-a65a-962dcd96961b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cc3998ef-253c-4a61-a65a-962dcd96961b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cc3998ef-253c-4a61-a65a-962dcd96961b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:21 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:21 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:21 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cc3998ef-253c-4a61-a65a-962dcd96961b tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.375s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:21 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-cc3998ef-253c-4a61-a65a-962dcd96961b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:21 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-cc3998ef-253c-4a61-a65a-962dcd96961b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Deleted volume successfully. Sep 23 15:27:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cc3998ef-253c-4a61-a65a-962dcd96961b tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-44f7e110-9d11-4dc4-8aad-40b33c2c94b9-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9f9b57f6-af53-4908-baea-368597980766 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "cinder-a20ee897-a96c-44cd-9d1c-51ec18140945-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9f9b57f6-af53-4908-baea-368597980766 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-a20ee897-a96c-44cd-9d1c-51ec18140945-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9f9b57f6-af53-4908-baea-368597980766 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "cinder-quobyte-a20ee897-a96c-44cd-9d1c-51ec18140945" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9f9b57f6-af53-4908-baea-368597980766 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-quobyte-a20ee897-a96c-44cd-9d1c-51ec18140945" acquired by "delete_volume" :: waited 0.029s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:22 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[08420e2c-e08c-4389-b7fe-61b354a22d71]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9f9b57f6-af53-4908-baea-368597980766 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a20ee897-a96c-44cd-9d1c-51ec18140945 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:22 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a20ee897-a96c-44cd-9d1c-51ec18140945 Sep 23 15:27:22 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:22 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9f9b57f6-af53-4908-baea-368597980766 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a20ee897-a96c-44cd-9d1c-51ec18140945" returned: 0 in 0.430s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9f9b57f6-af53-4908-baea-368597980766 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a20ee897-a96c-44cd-9d1c-51ec18140945 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:22 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a20ee897-a96c-44cd-9d1c-51ec18140945 Sep 23 15:27:22 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:23 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9f9b57f6-af53-4908-baea-368597980766 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a20ee897-a96c-44cd-9d1c-51ec18140945" returned: 0 in 0.400s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Flow 'volume_create_manager' (8a6d0782-7048-4abb-afbd-fe4fc3feaf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6088a18d-b5a7-43c1-a05b-16741bc1dc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9f9b57f6-af53-4908-baea-368597980766 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-quobyte-a20ee897-a96c-44cd-9d1c-51ec18140945" released by "delete_volume" :: held 0.924s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6088a18d-b5a7-43c1-a05b-16741bc1dc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1348507848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0804999-76e4-4eec-934b-6c91222c7667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a898a9c7f294c10bcab8ab3f70e4328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:23Z,use_quota=True,user_id='25f7ea8f09fb4419834fbe888027b0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1e54f7-5cba-41f9-b400-81ea98525f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1e54f7-5cba-41f9-b400-81ea98525f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c11ec0-d087-4dbf-8266-5371fde20a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c11ec0-d087-4dbf-8266-5371fde20a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0804999-76e4-4eec-934b-6c91222c7667', 'volume_name': 'volume-c0804999-76e4-4eec-934b-6c91222c7667', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccbf0ed-a235-46ef-94eb-0dc985d2fa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccbf0ed-a235-46ef-94eb-0dc985d2fa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f014fd04-c179-4b80-ab78-7047a8de7cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:23 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Volume c0804999-76e4-4eec-934b-6c91222c7667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0804999-76e4-4eec-934b-6c91222c7667', 'volume_size': 1} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1348507848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0804999-76e4-4eec-934b-6c91222c7667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a898a9c7f294c10bcab8ab3f70e4328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:23Z,use_quota=True,user_id='25f7ea8f09fb4419834fbe888027b0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Creating volume c0804999-76e4-4eec-934b-6c91222c7667 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:23 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c0804999-76e4-4eec-934b-6c91222c7667 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:23 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c0804999-76e4-4eec-934b-6c91222c7667 1073741824 Sep 23 15:27:23 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-9f9b57f6-af53-4908-baea-368597980766 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Created reservations ['78b81c7f-61ed-400f-9119-97fc56c1946a', '20865bc2-1d4a-4511-b198-a4e2dd765775', 'd474de20-c934-4497-9bd1-92d7bee0f73d', '2c4e19d0-dd60-4f0f-bd57-86e45651eecb'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9f9b57f6-af53-4908-baea-368597980766 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9f9b57f6-af53-4908-baea-368597980766 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9f9b57f6-af53-4908-baea-368597980766 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9f9b57f6-af53-4908-baea-368597980766 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9f9b57f6-af53-4908-baea-368597980766 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9f9b57f6-af53-4908-baea-368597980766 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:23 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:23 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:23 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9f9b57f6-af53-4908-baea-368597980766 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.328s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-9f9b57f6-af53-4908-baea-368597980766 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:23 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-9f9b57f6-af53-4908-baea-368597980766 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Deleted volume successfully. Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9f9b57f6-af53-4908-baea-368597980766 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-a20ee897-a96c-44cd-9d1c-51ec18140945-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:23 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c0804999-76e4-4eec-934b-6c91222c7667 1073741824" returned: 0 in 0.649s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c0804999-76e4-4eec-934b-6c91222c7667 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:23 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c0804999-76e4-4eec-934b-6c91222c7667 Sep 23 15:27:23 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:24 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c0804999-76e4-4eec-934b-6c91222c7667" returned: 0 in 0.306s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f014fd04-c179-4b80-ab78-7047a8de7cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0804999-76e4-4eec-934b-6c91222c7667', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d3041f-6fd8-4007-88db-ee4dbe130c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:24 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Volume volume-c0804999-76e4-4eec-934b-6c91222c7667 (c0804999-76e4-4eec-934b-6c91222c7667): created successfully Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d3041f-6fd8-4007-88db-ee4dbe130c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Flow 'volume_create_manager' (8a6d0782-7048-4abb-afbd-fe4fc3feaf4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:24 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-3ae3eebb-e8a4-43b9-8e6a-db29c2ac39a5 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Created volume successfully. Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-48477f49-2a47-4034-9f32-694d580648a5 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "cinder-ee4639cc-937b-4bf8-93bd-524355dfccb2-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-48477f49-2a47-4034-9f32-694d580648a5 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-ee4639cc-937b-4bf8-93bd-524355dfccb2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-48477f49-2a47-4034-9f32-694d580648a5 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "cinder-quobyte-ee4639cc-937b-4bf8-93bd-524355dfccb2" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-48477f49-2a47-4034-9f32-694d580648a5 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-quobyte-ee4639cc-937b-4bf8-93bd-524355dfccb2" acquired by "delete_volume" :: waited 0.031s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Flow 'volume_create_manager' (b259f5f7-df11-4f0a-8add-c759d5a602fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e32443d-e420-4bec-b9b1-68c7816d91a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5711b3e1-e805-440f-a38e-04738960ace3]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-48477f49-2a47-4034-9f32-694d580648a5 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ee4639cc-937b-4bf8-93bd-524355dfccb2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e32443d-e420-4bec-b9b1-68c7816d91a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1582380484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70feb9da-e0b4-4d9c-a674-5e7119d1bb6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0701211cdc894f3f9c5352f8a74afe2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:24Z,use_quota=True,user_id='00abe03f927f4cae85aa49d5d3d0ebf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efcc0477-e23f-4628-b202-f08c6a36aa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efcc0477-e23f-4628-b202-f08c6a36aa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695ee99b-47be-41de-a361-c0a3817fde9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695ee99b-47be-41de-a361-c0a3817fde9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70feb9da-e0b4-4d9c-a674-5e7119d1bb6a', 'volume_name': 'volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1bbf7b8-524a-459f-b178-2133ec8128ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1bbf7b8-524a-459f-b178-2133ec8128ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1fc9726-4115-4c4c-b99b-0f31f427f306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:24 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Volume 70feb9da-e0b4-4d9c-a674-5e7119d1bb6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a', 'volume_size': 1} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1582380484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70feb9da-e0b4-4d9c-a674-5e7119d1bb6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0701211cdc894f3f9c5352f8a74afe2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:24Z,use_quota=True,user_id='00abe03f927f4cae85aa49d5d3d0ebf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Creating volume 70feb9da-e0b4-4d9c-a674-5e7119d1bb6a {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:24 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:24 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a 1073741824 Sep 23 15:27:24 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:24 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ee4639cc-937b-4bf8-93bd-524355dfccb2 Sep 23 15:27:24 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:25 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-48477f49-2a47-4034-9f32-694d580648a5 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ee4639cc-937b-4bf8-93bd-524355dfccb2" returned: 0 in 0.437s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-48477f49-2a47-4034-9f32-694d580648a5 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ee4639cc-937b-4bf8-93bd-524355dfccb2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:25 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ee4639cc-937b-4bf8-93bd-524355dfccb2 Sep 23 15:27:25 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:25 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a 1073741824" returned: 0 in 0.580s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:25 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-48477f49-2a47-4034-9f32-694d580648a5 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ee4639cc-937b-4bf8-93bd-524355dfccb2" returned: 0 in 0.340s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:25 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a Sep 23 15:27:25 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:25 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-48477f49-2a47-4034-9f32-694d580648a5 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-quobyte-ee4639cc-937b-4bf8-93bd-524355dfccb2" released by "delete_volume" :: held 0.886s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:25 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-48477f49-2a47-4034-9f32-694d580648a5 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Created reservations ['c5c9735c-8dc0-4a11-8ed2-74b9f7bee2cb', '84143b92-937a-415b-be33-c3d34b6506c8', 'b9a829e8-f204-4356-a00d-6fe8ad9346fa', '56564b84-823e-4bbd-81f9-91f2a9cc08ad'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-48477f49-2a47-4034-9f32-694d580648a5 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-48477f49-2a47-4034-9f32-694d580648a5 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-48477f49-2a47-4034-9f32-694d580648a5 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-48477f49-2a47-4034-9f32-694d580648a5 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-48477f49-2a47-4034-9f32-694d580648a5 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-48477f49-2a47-4034-9f32-694d580648a5 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:25 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:25 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:25 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a" returned: 0 in 0.526s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1fc9726-4115-4c4c-b99b-0f31f427f306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3999486f-0506-4477-934f-f52f9939ff33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:25 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Volume volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a (70feb9da-e0b4-4d9c-a674-5e7119d1bb6a): created successfully Sep 23 15:27:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3999486f-0506-4477-934f-f52f9939ff33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:25 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Flow 'volume_create_manager' (b259f5f7-df11-4f0a-8add-c759d5a602fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:25 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-dee89441-12a6-4258-aacc-71fbaa1122bc tempest-VolumeDependencyTests-998585106 None] Created volume successfully. Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Flow 'volume_create_manager' (9906ef17-71b4-490e-b86d-c53a53ad40d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5415bf2f-abc2-4e42-849b-d680257088dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5415bf2f-abc2-4e42-849b-d680257088dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-531020002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12ad5cb-a3a1-4e7b-95c1-94110714312a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a898a9c7f294c10bcab8ab3f70e4328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:26Z,use_quota=True,user_id='25f7ea8f09fb4419834fbe888027b0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3952ed4e-ac16-4629-8ee4-f4ca2b69baf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3952ed4e-ac16-4629-8ee4-f4ca2b69baf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab66ff3-4694-4d0c-9c37-285f7ef92350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab66ff3-4694-4d0c-9c37-285f7ef92350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c12ad5cb-a3a1-4e7b-95c1-94110714312a', 'volume_name': 'volume-c12ad5cb-a3a1-4e7b-95c1-94110714312a', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e11d2153-3606-41ae-9e4b-1e144be7118e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e11d2153-3606-41ae-9e4b-1e144be7118e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2843326-e3df-4284-9d4e-d4b6d0d09767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:26 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Volume c12ad5cb-a3a1-4e7b-95c1-94110714312a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c12ad5cb-a3a1-4e7b-95c1-94110714312a', 'volume_size': 1} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-531020002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12ad5cb-a3a1-4e7b-95c1-94110714312a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a898a9c7f294c10bcab8ab3f70e4328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:26Z,use_quota=True,user_id='25f7ea8f09fb4419834fbe888027b0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Creating volume c12ad5cb-a3a1-4e7b-95c1-94110714312a {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:26 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c12ad5cb-a3a1-4e7b-95c1-94110714312a 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:26 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-48477f49-2a47-4034-9f32-694d580648a5 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.481s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-48477f49-2a47-4034-9f32-694d580648a5 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:26 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-48477f49-2a47-4034-9f32-694d580648a5 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Deleted volume successfully. Sep 23 15:27:26 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c12ad5cb-a3a1-4e7b-95c1-94110714312a 1073741824 Sep 23 15:27:26 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-48477f49-2a47-4034-9f32-694d580648a5 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-ee4639cc-937b-4bf8-93bd-524355dfccb2-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Flow 'volume_create_manager' (1f5fdd6a-1590-4418-a79c-cfaa9ef9863f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2464dc66-294d-4d55-b113-0f2ccf0d8141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2464dc66-294d-4d55-b113-0f2ccf0d8141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1417509398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00df9d0-bb89-4876-a64d-8a8c36b5dfaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a898a9c7f294c10bcab8ab3f70e4328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:26Z,use_quota=True,user_id='25f7ea8f09fb4419834fbe888027b0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f59553-012a-4d73-a3a7-fe8a500fa455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f59553-012a-4d73-a3a7-fe8a500fa455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddd4a82-3bec-4ebc-8a5c-b47bac2fcb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddd4a82-3bec-4ebc-8a5c-b47bac2fcb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd00df9d0-bb89-4876-a64d-8a8c36b5dfaa', 'volume_name': 'volume-d00df9d0-bb89-4876-a64d-8a8c36b5dfaa', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ca1ed9-75f7-48bd-b4e8-451c33a39614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ca1ed9-75f7-48bd-b4e8-451c33a39614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97867a4-f909-4de9-8f08-f019efb0df1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:26 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Volume d00df9d0-bb89-4876-a64d-8a8c36b5dfaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d00df9d0-bb89-4876-a64d-8a8c36b5dfaa', 'volume_size': 1} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:26 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c12ad5cb-a3a1-4e7b-95c1-94110714312a 1073741824" returned: 0 in 0.723s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c12ad5cb-a3a1-4e7b-95c1-94110714312a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:26 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c12ad5cb-a3a1-4e7b-95c1-94110714312a Sep 23 15:27:26 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-469b1ce1-3e85-4023-a45c-65e6eee29789 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "cinder-6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-469b1ce1-3e85-4023-a45c-65e6eee29789 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-469b1ce1-3e85-4023-a45c-65e6eee29789 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "cinder-quobyte-6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:27 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c12ad5cb-a3a1-4e7b-95c1-94110714312a" returned: 0 in 0.384s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.732s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1417509398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00df9d0-bb89-4876-a64d-8a8c36b5dfaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a898a9c7f294c10bcab8ab3f70e4328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:26Z,use_quota=True,user_id='25f7ea8f09fb4419834fbe888027b0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Creating volume d00df9d0-bb89-4876-a64d-8a8c36b5dfaa {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:27 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:27 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d00df9d0-bb89-4876-a64d-8a8c36b5dfaa 1073741824 Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d00df9d0-bb89-4876-a64d-8a8c36b5dfaa 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-469b1ce1-3e85-4023-a45c-65e6eee29789 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-quobyte-6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf" acquired by "delete_volume" :: waited 0.094s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7624502d-a0ad-4684-9d1a-f6c0cb25b616 tempest-VolumeDependencyTests-998585106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Flow 'volume_create_manager' (630c22ac-5b1a-43c7-b584-7d91a34126fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0da8e1-2ce5-4e02-8b34-fd3afac41a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fa2255-cba4-4b25-9cb0-e974f9bd7113]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-469b1ce1-3e85-4023-a45c-65e6eee29789 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:27 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2843326-e3df-4284-9d4e-d4b6d0d09767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c12ad5cb-a3a1-4e7b-95c1-94110714312a', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (053d727a-dddc-4bc2-9f5f-49477cdd7a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0da8e1-2ce5-4e02-8b34-fd3afac41a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1355921229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbee4e70-0437-4676-9072-9e161d3d2ff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a898a9c7f294c10bcab8ab3f70e4328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:27Z,use_quota=True,user_id='25f7ea8f09fb4419834fbe888027b0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2751ecb-1d31-4266-acf4-43230323a4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2751ecb-1d31-4266-acf4-43230323a4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4766e9e7-5b82-473e-8c21-206de460c614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4766e9e7-5b82-473e-8c21-206de460c614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbee4e70-0437-4676-9072-9e161d3d2ff6', 'volume_name': 'volume-cbee4e70-0437-4676-9072-9e161d3d2ff6', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86f1f52-602f-4616-8644-d57f70223cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86f1f52-602f-4616-8644-d57f70223cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a13737-5cf4-4284-926c-e136ccf3cd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:27 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Volume cbee4e70-0437-4676-9072-9e161d3d2ff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbee4e70-0437-4676-9072-9e161d3d2ff6', 'volume_size': 1} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:27 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Volume volume-c12ad5cb-a3a1-4e7b-95c1-94110714312a (c12ad5cb-a3a1-4e7b-95c1-94110714312a): created successfully Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (053d727a-dddc-4bc2-9f5f-49477cdd7a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Flow 'volume_create_manager' (9906ef17-71b4-490e-b86d-c53a53ad40d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:27 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-4ace5060-ffb7-468e-8774-6a2961b82e0a tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Created volume successfully. Sep 23 15:27:27 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf Sep 23 15:27:27 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Flow 'volume_create_manager' (59b0df48-c168-42c9-a2f7-86294cf54055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a64953-3d21-4e3d-81fd-0b643a3fd693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a64953-3d21-4e3d-81fd-0b643a3fd693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-586627465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e653c0-fc54-44d4-b6e6-476e74705459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a898a9c7f294c10bcab8ab3f70e4328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:28Z,use_quota=True,user_id='25f7ea8f09fb4419834fbe888027b0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd4db64c-7c57-4a9a-923f-f1aacedabb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd4db64c-7c57-4a9a-923f-f1aacedabb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bb15520-c8aa-40fa-88ba-828cd010e9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bb15520-c8aa-40fa-88ba-828cd010e9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4e653c0-fc54-44d4-b6e6-476e74705459', 'volume_name': 'volume-e4e653c0-fc54-44d4-b6e6-476e74705459', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e41a09c-2237-47a4-9597-4a50844747f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e41a09c-2237-47a4-9597-4a50844747f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d36301d-a439-45fb-815e-9440988c95a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:28 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Volume e4e653c0-fc54-44d4-b6e6-476e74705459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4e653c0-fc54-44d4-b6e6-476e74705459', 'volume_size': 1} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:28 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d00df9d0-bb89-4876-a64d-8a8c36b5dfaa 1073741824" returned: 0 in 0.730s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:28 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-469b1ce1-3e85-4023-a45c-65e6eee29789 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf" returned: 0 in 0.617s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-469b1ce1-3e85-4023-a45c-65e6eee29789 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:28 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf Sep 23 15:27:28 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d00df9d0-bb89-4876-a64d-8a8c36b5dfaa {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:28 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d00df9d0-bb89-4876-a64d-8a8c36b5dfaa Sep 23 15:27:28 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:28 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-469b1ce1-3e85-4023-a45c-65e6eee29789 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf" returned: 0 in 0.406s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Flow 'volume_create_manager' (12831e08-66e0-48d9-9ba0-cd0811cb1c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bcd1156-f513-4dad-9a79-110bc05e3cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-469b1ce1-3e85-4023-a45c-65e6eee29789 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-quobyte-6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf" released by "delete_volume" :: held 1.191s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:28 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d00df9d0-bb89-4876-a64d-8a8c36b5dfaa" returned: 0 in 0.428s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7624502d-a0ad-4684-9d1a-f6c0cb25b616 tempest-VolumeDependencyTests-998585106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.160s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bcd1156-f513-4dad-9a79-110bc05e3cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-154006308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e138e4b7-b190-4f11-a00c-20b7f1b6a66e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a898a9c7f294c10bcab8ab3f70e4328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:28Z,use_quota=True,user_id='25f7ea8f09fb4419834fbe888027b0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f05b0c5-44a5-4602-9cd0-a543a4318e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f05b0c5-44a5-4602-9cd0-a543a4318e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d138bbad-3f7e-4f0a-a0d7-aab989a9fdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d138bbad-3f7e-4f0a-a0d7-aab989a9fdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e138e4b7-b190-4f11-a00c-20b7f1b6a66e', 'volume_name': 'volume-e138e4b7-b190-4f11-a00c-20b7f1b6a66e', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e0dc48-fcf3-400e-82a2-a6bcf55f704d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e0dc48-fcf3-400e-82a2-a6bcf55f704d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ec99e8-e290-43cf-8917-27059d204127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:28 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Volume e138e4b7-b190-4f11-a00c-20b7f1b6a66e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e138e4b7-b190-4f11-a00c-20b7f1b6a66e', 'volume_size': 1} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97867a4-f909-4de9-8f08-f019efb0df1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d00df9d0-bb89-4876-a64d-8a8c36b5dfaa', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12eb0716-8add-4ddb-a52a-f4a80962375f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:28 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Volume volume-d00df9d0-bb89-4876-a64d-8a8c36b5dfaa (d00df9d0-bb89-4876-a64d-8a8c36b5dfaa): created successfully Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12eb0716-8add-4ddb-a52a-f4a80962375f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Flow 'volume_create_manager' (1f5fdd6a-1590-4418-a79c-cfaa9ef9863f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-7624502d-a0ad-4684-9d1a-f6c0cb25b616 tempest-VolumeDependencyTests-998585106 None] Creating offline snapshot 1363706d-3316-4c35-a00e-c209ae4623b8 of volume 70feb9da-e0b4-4d9c-a674-5e7119d1bb6a {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:27:28 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-1f7da7c3-c4d5-45bf-ad9e-fdcaec984447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Created volume successfully. Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a88d2b-4a44-41b7-ad83-0007943c88f2]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7624502d-a0ad-4684-9d1a-f6c0cb25b616 tempest-VolumeDependencyTests-998585106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-469b1ce1-3e85-4023-a45c-65e6eee29789 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Created reservations ['374faeca-78bd-4b65-8a37-9cbf3a782ac9', '0f296936-474a-42f3-82ce-1ca0d395e6b2', 'b1088921-e51d-4c82-ac89-462be6fed26f', '3f75f34d-c2c7-488e-87c3-1ff4cb15b4f0'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-469b1ce1-3e85-4023-a45c-65e6eee29789 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-469b1ce1-3e85-4023-a45c-65e6eee29789 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-469b1ce1-3e85-4023-a45c-65e6eee29789 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-469b1ce1-3e85-4023-a45c-65e6eee29789 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-469b1ce1-3e85-4023-a45c-65e6eee29789 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-469b1ce1-3e85-4023-a45c-65e6eee29789 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:28 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a Sep 23 15:27:28 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:28 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:28 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:29 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-469b1ce1-3e85-4023-a45c-65e6eee29789 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.321s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-469b1ce1-3e85-4023-a45c-65e6eee29789 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:29 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-469b1ce1-3e85-4023-a45c-65e6eee29789 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Deleted volume successfully. Sep 23 15:27:29 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-469b1ce1-3e85-4023-a45c-65e6eee29789 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-6e91c9b1-3c44-4c2b-a4bd-8c74f04917cf-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7624502d-a0ad-4684-9d1a-f6c0cb25b616 tempest-VolumeDependencyTests-998585106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a" returned: 0 in 0.486s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7624502d-a0ad-4684-9d1a-f6c0cb25b616 tempest-VolumeDependencyTests-998585106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:29 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8 1G Sep 23 15:27:29 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Flow 'volume_create_manager' (85d07a90-05b9-4988-8010-2b0de37314ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39272215-ab9f-4d08-89b8-8ec2df917eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39272215-ab9f-4d08-89b8-8ec2df917eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-587103648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb7d3640-314e-4896-907d-1c20515d6e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbceb64ac6814047a26a6f304e568f2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:29Z,use_quota=True,user_id='aee5096b35d64a66891fa411075b5472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edf8bea0-85eb-442b-9b57-ce6f67167a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edf8bea0-85eb-442b-9b57-ce6f67167a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f71f72-134e-4357-ae0e-44291497d81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f71f72-134e-4357-ae0e-44291497d81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb7d3640-314e-4896-907d-1c20515d6e0e', 'volume_name': 'volume-bb7d3640-314e-4896-907d-1c20515d6e0e', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41d3793-5b0d-4cc1-b52a-bbd3ef55fa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41d3793-5b0d-4cc1-b52a-bbd3ef55fa54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b891f3-8639-43f4-b2c3-7b508bb57279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:29 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Volume bb7d3640-314e-4896-907d-1c20515d6e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb7d3640-314e-4896-907d-1c20515d6e0e', 'volume_size': 1} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8870b826-7bac-4171-a4e9-cfb513c9e133 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "cinder-002e074e-cb3f-436b-890e-a057cba2d7c6-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8870b826-7bac-4171-a4e9-cfb513c9e133 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-002e074e-cb3f-436b-890e-a057cba2d7c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8870b826-7bac-4171-a4e9-cfb513c9e133 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "cinder-quobyte-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8870b826-7bac-4171-a4e9-cfb513c9e133 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-quobyte-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8870b826-7bac-4171-a4e9-cfb513c9e133 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "cinder-quobyte-002e074e-cb3f-436b-890e-a057cba2d7c6" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8870b826-7bac-4171-a4e9-cfb513c9e133 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-quobyte-002e074e-cb3f-436b-890e-a057cba2d7c6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-8870b826-7bac-4171-a4e9-cfb513c9e133 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Deleting offline snapshot 002e074e-cb3f-436b-890e-a057cba2d7c6 of volume d39188bf-6cbe-4f2e-a109-53ab3e9a68fb {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-8870b826-7bac-4171-a4e9-cfb513c9e133 tempest-CreateVolumesFromSnapshotTest-1011635465 None] snapshot_file for this snap is: volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.002e074e-cb3f-436b-890e-a057cba2d7c6 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[471c150a-abdb-4454-b563-67a8156d981f]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8870b826-7bac-4171-a4e9-cfb513c9e133 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.002e074e-cb3f-436b-890e-a057cba2d7c6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:29 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.002e074e-cb3f-436b-890e-a057cba2d7c6 Sep 23 15:27:29 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:29 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7624502d-a0ad-4684-9d1a-f6c0cb25b616 tempest-VolumeDependencyTests-998585106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8 1G" returned: 0 in 0.489s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7624502d-a0ad-4684-9d1a-f6c0cb25b616 tempest-VolumeDependencyTests-998585106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:29 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8 Sep 23 15:27:29 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:30 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8870b826-7bac-4171-a4e9-cfb513c9e133 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.002e074e-cb3f-436b-890e-a057cba2d7c6" returned: 0 in 0.388s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-8870b826-7bac-4171-a4e9-cfb513c9e133 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:27:30 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b7ba39-bfa6-4a6a-859b-3d3bc44a8631]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8870b826-7bac-4171-a4e9-cfb513c9e133 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:30 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7624502d-a0ad-4684-9d1a-f6c0cb25b616 tempest-VolumeDependencyTests-998585106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8" returned: 0 in 0.359s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:30 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-7624502d-a0ad-4684-9d1a-f6c0cb25b616 tempest-VolumeDependencyTests-998585106 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8 is being set with open permissions: ugo+rw Sep 23 15:27:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7624502d-a0ad-4684-9d1a-f6c0cb25b616 tempest-VolumeDependencyTests-998585106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:30 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb Sep 23 15:27:30 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:30 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8 Sep 23 15:27:30 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:30 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7624502d-a0ad-4684-9d1a-f6c0cb25b616 tempest-VolumeDependencyTests-998585106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8" returned: 0 in 0.292s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:30 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8870b826-7bac-4171-a4e9-cfb513c9e133 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb" returned: 0 in 0.414s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8870b826-7bac-4171-a4e9-cfb513c9e133 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.002e074e-cb3f-436b-890e-a057cba2d7c6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7624502d-a0ad-4684-9d1a-f6c0cb25b616 tempest-VolumeDependencyTests-998585106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:30 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.002e074e-cb3f-436b-890e-a057cba2d7c6 Sep 23 15:27:30 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:30 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.info Sep 23 15:27:30 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:30 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7624502d-a0ad-4684-9d1a-f6c0cb25b616 tempest-VolumeDependencyTests-998585106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.info" returned: 0 in 0.280s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:30 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-7624502d-a0ad-4684-9d1a-f6c0cb25b616 tempest-VolumeDependencyTests-998585106 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.info is being set with open permissions: ugo+rw Sep 23 15:27:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7624502d-a0ad-4684-9d1a-f6c0cb25b616 tempest-VolumeDependencyTests-998585106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:30 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.info Sep 23 15:27:30 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:30 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8870b826-7bac-4171-a4e9-cfb513c9e133 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.002e074e-cb3f-436b-890e-a057cba2d7c6" returned: 0 in 0.402s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8870b826-7bac-4171-a4e9-cfb513c9e133 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.002e074e-cb3f-436b-890e-a057cba2d7c6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:30 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.002e074e-cb3f-436b-890e-a057cba2d7c6 Sep 23 15:27:30 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:31 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7624502d-a0ad-4684-9d1a-f6c0cb25b616 tempest-VolumeDependencyTests-998585106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.info" returned: 0 in 0.259s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7624502d-a0ad-4684-9d1a-f6c0cb25b616 tempest-VolumeDependencyTests-998585106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.422s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.408s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1355921229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbee4e70-0437-4676-9072-9e161d3d2ff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a898a9c7f294c10bcab8ab3f70e4328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:27Z,use_quota=True,user_id='25f7ea8f09fb4419834fbe888027b0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Creating volume cbee4e70-0437-4676-9072-9e161d3d2ff6 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:31 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cbee4e70-0437-4676-9072-9e161d3d2ff6 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:31 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cbee4e70-0437-4676-9072-9e161d3d2ff6 1073741824 Sep 23 15:27:31 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:31 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7624502d-a0ad-4684-9d1a-f6c0cb25b616 tempest-VolumeDependencyTests-998585106 None] Create snapshot completed successfully Sep 23 15:27:31 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-8870b826-7bac-4171-a4e9-cfb513c9e133 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb.002e074e-cb3f-436b-890e-a057cba2d7c6" returned: 0 in 0.283s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8870b826-7bac-4171-a4e9-cfb513c9e133 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-quobyte-002e074e-cb3f-436b-890e-a057cba2d7c6" released by "_delete_snapshot" :: held 1.604s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8870b826-7bac-4171-a4e9-cfb513c9e133 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-quobyte-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb" released by "delete_snapshot" :: held 1.635s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-8870b826-7bac-4171-a4e9-cfb513c9e133 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Created reservations ['fc8021af-427b-4f19-9de0-a403c6453629', 'f86be22e-e418-4851-a682-6adf2e1b6bb8', '8375b299-855d-4f69-9906-c6a63e6efd95', '326bf418-e00f-4c9f-b3b1-a9cf8c8ffb74'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:31 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-8870b826-7bac-4171-a4e9-cfb513c9e133 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Delete snapshot completed successfully. Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-8870b826-7bac-4171-a4e9-cfb513c9e133 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-002e074e-cb3f-436b-890e-a057cba2d7c6-delete_snapshot" released by "delete_snapshot" :: held 1.809s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:31 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cbee4e70-0437-4676-9072-9e161d3d2ff6 1073741824" returned: 0 in 0.503s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cbee4e70-0437-4676-9072-9e161d3d2ff6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:31 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cbee4e70-0437-4676-9072-9e161d3d2ff6 Sep 23 15:27:31 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-48c39536-e6c6-4668-a969-5f55a78bf6a9 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "cinder-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-48c39536-e6c6-4668-a969-5f55a78bf6a9 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-48c39536-e6c6-4668-a969-5f55a78bf6a9 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "cinder-quobyte-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-48c39536-e6c6-4668-a969-5f55a78bf6a9 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-quobyte-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb" acquired by "delete_volume" :: waited 0.019s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace53361-f324-4c44-a236-4815d29bfc9f]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-48c39536-e6c6-4668-a969-5f55a78bf6a9 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:31 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cbee4e70-0437-4676-9072-9e161d3d2ff6" returned: 0 in 0.339s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.831s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-586627465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e653c0-fc54-44d4-b6e6-476e74705459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a898a9c7f294c10bcab8ab3f70e4328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:28Z,use_quota=True,user_id='25f7ea8f09fb4419834fbe888027b0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Creating volume e4e653c0-fc54-44d4-b6e6-476e74705459 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:31 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4e653c0-fc54-44d4-b6e6-476e74705459 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a13737-5cf4-4284-926c-e136ccf3cd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbee4e70-0437-4676-9072-9e161d3d2ff6', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:31 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4e653c0-fc54-44d4-b6e6-476e74705459 1073741824 Sep 23 15:27:31 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5963041-4331-4c82-8fed-0862fecf57a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:31 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:32 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Volume volume-cbee4e70-0437-4676-9072-9e161d3d2ff6 (cbee4e70-0437-4676-9072-9e161d3d2ff6): created successfully Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5963041-4331-4c82-8fed-0862fecf57a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Flow 'volume_create_manager' (630c22ac-5b1a-43c7-b584-7d91a34126fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:32 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb Sep 23 15:27:32 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:32 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-e214f097-5c92-493d-83f7-9e9a02390194 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Created volume successfully. Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Flow 'volume_create_manager' (4268438a-2f1d-4b9c-99c3-be0674fd05a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ed9ae6-a4ab-4bd9-bee3-c9a7f572f92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ed9ae6-a4ab-4bd9-bee3-c9a7f572f92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1639451012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a043df-b425-4585-9b83-f74badf63117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0701211cdc894f3f9c5352f8a74afe2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1363706d-3316-4c35-a00e-c209ae4623b8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:32Z,use_quota=True,user_id='00abe03f927f4cae85aa49d5d3d0ebf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7d2e97-27b4-4428-885a-b69dad06979f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7d2e97-27b4-4428-885a-b69dad06979f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d1335e-46d9-4f13-8135-e778f53ea4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d1335e-46d9-4f13-8135-e778f53ea4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a5a043df-b425-4585-9b83-f74badf63117', 'volume_name': 'volume-a5a043df-b425-4585-9b83-f74badf63117', 'volume_size': 1, 'snapshot_id': '1363706d-3316-4c35-a00e-c209ae4623b8'}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b028a2c1-2f37-4236-a85e-eab2d87078dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b028a2c1-2f37-4236-a85e-eab2d87078dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d11d61d-485a-44ce-a266-81bf593ab19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:32 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Volume a5a043df-b425-4585-9b83-f74badf63117: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a5a043df-b425-4585-9b83-f74badf63117', 'volume_size': 1, 'snapshot_id': '1363706d-3316-4c35-a00e-c209ae4623b8'} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:32 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-48c39536-e6c6-4668-a969-5f55a78bf6a9 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb" returned: 0 in 0.427s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-48c39536-e6c6-4668-a969-5f55a78bf6a9 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:32 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb Sep 23 15:27:32 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:32 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4e653c0-fc54-44d4-b6e6-476e74705459 1073741824" returned: 0 in 0.549s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4e653c0-fc54-44d4-b6e6-476e74705459 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:32 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4e653c0-fc54-44d4-b6e6-476e74705459 Sep 23 15:27:32 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:32 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-48c39536-e6c6-4668-a969-5f55a78bf6a9 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb" returned: 0 in 0.291s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-48c39536-e6c6-4668-a969-5f55a78bf6a9 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-quobyte-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb" released by "delete_volume" :: held 0.811s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-48c39536-e6c6-4668-a969-5f55a78bf6a9 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Created reservations ['22824ca2-1116-42a2-bb1b-5fdab79a897a', '8a3d8cca-1329-4882-8a93-8767c3dba8ef', 'd8e58442-09c5-4f4d-abac-50447d8bc730', '57de5596-b45c-492c-a1a5-e569c7161c45'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-48c39536-e6c6-4668-a969-5f55a78bf6a9 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-48c39536-e6c6-4668-a969-5f55a78bf6a9 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-48c39536-e6c6-4668-a969-5f55a78bf6a9 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-48c39536-e6c6-4668-a969-5f55a78bf6a9 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-48c39536-e6c6-4668-a969-5f55a78bf6a9 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-48c39536-e6c6-4668-a969-5f55a78bf6a9 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:32 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:32 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:32 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4e653c0-fc54-44d4-b6e6-476e74705459" returned: 0 in 0.279s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.137s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-154006308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e138e4b7-b190-4f11-a00c-20b7f1b6a66e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a898a9c7f294c10bcab8ab3f70e4328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:28Z,use_quota=True,user_id='25f7ea8f09fb4419834fbe888027b0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Creating volume e138e4b7-b190-4f11-a00c-20b7f1b6a66e {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:32 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e138e4b7-b190-4f11-a00c-20b7f1b6a66e 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d36301d-a439-45fb-815e-9440988c95a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4e653c0-fc54-44d4-b6e6-476e74705459', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1abb2e4b-d86c-4058-ba3d-2e725e8c18e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:32 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e138e4b7-b190-4f11-a00c-20b7f1b6a66e 1073741824 Sep 23 15:27:32 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:32 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Volume volume-e4e653c0-fc54-44d4-b6e6-476e74705459 (e4e653c0-fc54-44d4-b6e6-476e74705459): created successfully Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1abb2e4b-d86c-4058-ba3d-2e725e8c18e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:32 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Flow 'volume_create_manager' (59b0df48-c168-42c9-a2f7-86294cf54055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:32 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-9740aa47-cf0c-475c-bf17-08b5b4dbcd8b tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Created volume successfully. Sep 23 15:27:33 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-48c39536-e6c6-4668-a969-5f55a78bf6a9 tempest-CreateVolumesFromSnapshotTest-1011635465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.321s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:33 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-48c39536-e6c6-4668-a969-5f55a78bf6a9 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:33 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-48c39536-e6c6-4668-a969-5f55a78bf6a9 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Deleted volume successfully. Sep 23 15:27:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-48c39536-e6c6-4668-a969-5f55a78bf6a9 tempest-CreateVolumesFromSnapshotTest-1011635465 None] Lock "cinder-d39188bf-6cbe-4f2e-a109-53ab3e9a68fb-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:33 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e138e4b7-b190-4f11-a00c-20b7f1b6a66e 1073741824" returned: 0 in 0.615s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e138e4b7-b190-4f11-a00c-20b7f1b6a66e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:33 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e138e4b7-b190-4f11-a00c-20b7f1b6a66e Sep 23 15:27:33 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:33 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e138e4b7-b190-4f11-a00c-20b7f1b6a66e" returned: 0 in 0.273s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.374s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-587103648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb7d3640-314e-4896-907d-1c20515d6e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbceb64ac6814047a26a6f304e568f2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:29Z,use_quota=True,user_id='aee5096b35d64a66891fa411075b5472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Creating volume bb7d3640-314e-4896-907d-1c20515d6e0e {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:33 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:33 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:33 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bb7d3640-314e-4896-907d-1c20515d6e0e 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ec99e8-e290-43cf-8917-27059d204127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e138e4b7-b190-4f11-a00c-20b7f1b6a66e', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:33 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bb7d3640-314e-4896-907d-1c20515d6e0e 1073741824 Sep 23 15:27:33 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d43e110-476e-44a1-9769-112322f9e848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:33 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Volume volume-e138e4b7-b190-4f11-a00c-20b7f1b6a66e (e138e4b7-b190-4f11-a00c-20b7f1b6a66e): created successfully Sep 23 15:27:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d43e110-476e-44a1-9769-112322f9e848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:33 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Flow 'volume_create_manager' (12831e08-66e0-48d9-9ba0-cd0811cb1c8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:33 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-22a30176-068e-4da0-a5d2-bdb59dd57447 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Created volume successfully. Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-40692c4e-20ab-4637-8d77-2dcadef1ae38 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "cinder-e138e4b7-b190-4f11-a00c-20b7f1b6a66e-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-40692c4e-20ab-4637-8d77-2dcadef1ae38 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-e138e4b7-b190-4f11-a00c-20b7f1b6a66e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-40692c4e-20ab-4637-8d77-2dcadef1ae38 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "cinder-quobyte-e138e4b7-b190-4f11-a00c-20b7f1b6a66e" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-40692c4e-20ab-4637-8d77-2dcadef1ae38 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-quobyte-e138e4b7-b190-4f11-a00c-20b7f1b6a66e" acquired by "delete_volume" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c21dfd7-8ca2-44d8-84ef-ed2bfbd839fb]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-40692c4e-20ab-4637-8d77-2dcadef1ae38 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e138e4b7-b190-4f11-a00c-20b7f1b6a66e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:34 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bb7d3640-314e-4896-907d-1c20515d6e0e 1073741824" returned: 0 in 0.611s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:34 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e138e4b7-b190-4f11-a00c-20b7f1b6a66e Sep 23 15:27:34 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bb7d3640-314e-4896-907d-1c20515d6e0e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:34 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bb7d3640-314e-4896-907d-1c20515d6e0e Sep 23 15:27:34 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:34 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-40692c4e-20ab-4637-8d77-2dcadef1ae38 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e138e4b7-b190-4f11-a00c-20b7f1b6a66e" returned: 0 in 0.419s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-40692c4e-20ab-4637-8d77-2dcadef1ae38 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e138e4b7-b190-4f11-a00c-20b7f1b6a66e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:34 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bb7d3640-314e-4896-907d-1c20515d6e0e" returned: 0 in 0.309s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.536s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Acquiring lock "cinder-quobyte-1363706d-3316-4c35-a00e-c209ae4623b8-a5a043df-b425-4585-9b83-f74badf63117" by "_create_volume_from_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:34 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e138e4b7-b190-4f11-a00c-20b7f1b6a66e Sep 23 15:27:34 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b891f3-8639-43f4-b2c3-7b508bb57279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb7d3640-314e-4896-907d-1c20515d6e0e', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b3d8ef-2447-4eaa-8e05-032ebec5931b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Lock "cinder-quobyte-1363706d-3316-4c35-a00e-c209ae4623b8-a5a043df-b425-4585-9b83-f74badf63117" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Creating volume a5a043df-b425-4585-9b83-f74badf63117 from snapshot 1363706d-3316-4c35-a00e-c209ae4623b8 {{(pid=86064) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Acquiring lock "cinder-quobyte-a5a043df-b425-4585-9b83-f74badf63117" by "_copy_volume_from_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:34 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Volume volume-bb7d3640-314e-4896-907d-1c20515d6e0e (bb7d3640-314e-4896-907d-1c20515d6e0e): created successfully Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b3d8ef-2447-4eaa-8e05-032ebec5931b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Flow 'volume_create_manager' (85d07a90-05b9-4988-8010-2b0de37314ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Lock "cinder-quobyte-a5a043df-b425-4585-9b83-f74badf63117" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] snapshot: 1363706d-3316-4c35-a00e-c209ae4623b8, volume: a5a043df-b425-4585-9b83-f74badf63117, {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 15:27:34 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-bbeb737c-88c1-41a8-8c2c-acae93463185 tempest-ProjectReaderTests-1760292137 None] Created volume successfully. Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7b4698-b958-4b77-b751-7480ea584521]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:35 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8 Sep 23 15:27:35 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:35 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-40692c4e-20ab-4637-8d77-2dcadef1ae38 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e138e4b7-b190-4f11-a00c-20b7f1b6a66e" returned: 0 in 0.314s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-40692c4e-20ab-4637-8d77-2dcadef1ae38 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-quobyte-e138e4b7-b190-4f11-a00c-20b7f1b6a66e" released by "delete_volume" :: held 0.791s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-40692c4e-20ab-4637-8d77-2dcadef1ae38 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Created reservations ['6993d979-be50-4d9b-b99b-a2eb14ec50ec', 'fc82296c-dba1-4d93-b282-82eb5b79945a', '927d0f88-fadc-4b37-b8fd-3dbe0d2af456', '77960b82-a479-469a-8bdc-561e37dfcea8'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-40692c4e-20ab-4637-8d77-2dcadef1ae38 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-40692c4e-20ab-4637-8d77-2dcadef1ae38 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-40692c4e-20ab-4637-8d77-2dcadef1ae38 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-40692c4e-20ab-4637-8d77-2dcadef1ae38 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-40692c4e-20ab-4637-8d77-2dcadef1ae38 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-40692c4e-20ab-4637-8d77-2dcadef1ae38 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:35 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:35 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3e492732-2eaa-4ae0-8f26-42c14386ccc0 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "cinder-e4e653c0-fc54-44d4-b6e6-476e74705459-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:35 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8" returned: 0 in 0.485s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d195ef9a-d7e7-4587-a2a2-2fa48a08ea5e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3e492732-2eaa-4ae0-8f26-42c14386ccc0 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-e4e653c0-fc54-44d4-b6e6-476e74705459-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3e492732-2eaa-4ae0-8f26-42c14386ccc0 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "cinder-quobyte-e4e653c0-fc54-44d4-b6e6-476e74705459" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3e492732-2eaa-4ae0-8f26-42c14386ccc0 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-quobyte-e4e653c0-fc54-44d4-b6e6-476e74705459" acquired by "delete_volume" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac3e79a-2463-4563-a5cf-08f154321609]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e492732-2eaa-4ae0-8f26-42c14386ccc0 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4e653c0-fc54-44d4-b6e6-476e74705459 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:35 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-40692c4e-20ab-4637-8d77-2dcadef1ae38 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.347s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-40692c4e-20ab-4637-8d77-2dcadef1ae38 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:35 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-40692c4e-20ab-4637-8d77-2dcadef1ae38 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Deleted volume successfully. Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-40692c4e-20ab-4637-8d77-2dcadef1ae38 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-e138e4b7-b190-4f11-a00c-20b7f1b6a66e-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:35 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a Sep 23 15:27:35 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:35 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4e653c0-fc54-44d4-b6e6-476e74705459 Sep 23 15:27:35 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:35 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a" returned: 0 in 0.533s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Creating direct copy from snapshot {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG cinder.utils [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Path /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5a043df-b425-4585-9b83-f74badf63117 not found in is_blk_device check {{(pid=86064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 15:27:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5a043df-b425-4585-9b83-f74badf63117 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5ee56b6b-5511-4b9e-8a06-0baafa81b6df tempest-ProjectReaderTests-1760292137 None] Acquiring lock "cinder-bb7d3640-314e-4896-907d-1c20515d6e0e-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:36 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e492732-2eaa-4ae0-8f26-42c14386ccc0 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4e653c0-fc54-44d4-b6e6-476e74705459" returned: 0 in 0.450s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e492732-2eaa-4ae0-8f26-42c14386ccc0 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4e653c0-fc54-44d4-b6e6-476e74705459 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:36 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5a043df-b425-4585-9b83-f74badf63117 Sep 23 15:27:36 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5ee56b6b-5511-4b9e-8a06-0baafa81b6df tempest-ProjectReaderTests-1760292137 None] Lock "cinder-bb7d3640-314e-4896-907d-1c20515d6e0e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:36 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4e653c0-fc54-44d4-b6e6-476e74705459 Sep 23 15:27:36 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5ee56b6b-5511-4b9e-8a06-0baafa81b6df tempest-ProjectReaderTests-1760292137 None] Acquiring lock "cinder-quobyte-bb7d3640-314e-4896-907d-1c20515d6e0e" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5ee56b6b-5511-4b9e-8a06-0baafa81b6df tempest-ProjectReaderTests-1760292137 None] Lock "cinder-quobyte-bb7d3640-314e-4896-907d-1c20515d6e0e" acquired by "delete_volume" :: waited 0.026s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:36 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:36 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e7e2bd-efc1-4ab7-9b35-5c4a3e8a7439]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5ee56b6b-5511-4b9e-8a06-0baafa81b6df tempest-ProjectReaderTests-1760292137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bb7d3640-314e-4896-907d-1c20515d6e0e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:36 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e492732-2eaa-4ae0-8f26-42c14386ccc0 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e4e653c0-fc54-44d4-b6e6-476e74705459" returned: 0 in 0.349s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3e492732-2eaa-4ae0-8f26-42c14386ccc0 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-quobyte-e4e653c0-fc54-44d4-b6e6-476e74705459" released by "delete_volume" :: held 0.867s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:36 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bb7d3640-314e-4896-907d-1c20515d6e0e Sep 23 15:27:36 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-3e492732-2eaa-4ae0-8f26-42c14386ccc0 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Created reservations ['8c6e5ed1-5602-44ac-b1e1-655c9ffd87f5', 'c68dbb79-3e57-4e8b-9ca1-f3f86c00a817', '23f7f426-3f65-4e9c-8dbd-bb864c83ff8f', '51deb98f-ed63-4617-b7c2-b5ffcff19090'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:36 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.450s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 28 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3e492732-2eaa-4ae0-8f26-42c14386ccc0 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3e492732-2eaa-4ae0-8f26-42c14386ccc0 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3e492732-2eaa-4ae0-8f26-42c14386ccc0 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3e492732-2eaa-4ae0-8f26-42c14386ccc0 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3e492732-2eaa-4ae0-8f26-42c14386ccc0 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e492732-2eaa-4ae0-8f26-42c14386ccc0 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:36 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:36 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5360346d-2eee-4f06-af06-453e43832b65 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "cinder-cbee4e70-0437-4676-9072-9e161d3d2ff6-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5360346d-2eee-4f06-af06-453e43832b65 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-cbee4e70-0437-4676-9072-9e161d3d2ff6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5360346d-2eee-4f06-af06-453e43832b65 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "cinder-quobyte-cbee4e70-0437-4676-9072-9e161d3d2ff6" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5360346d-2eee-4f06-af06-453e43832b65 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-quobyte-cbee4e70-0437-4676-9072-9e161d3d2ff6" acquired by "delete_volume" :: waited 0.037s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:36 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5ee56b6b-5511-4b9e-8a06-0baafa81b6df tempest-ProjectReaderTests-1760292137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bb7d3640-314e-4896-907d-1c20515d6e0e" returned: 0 in 0.692s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5ee56b6b-5511-4b9e-8a06-0baafa81b6df tempest-ProjectReaderTests-1760292137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bb7d3640-314e-4896-907d-1c20515d6e0e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13239e6-fe05-4508-9f72-76d9736814dc]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5360346d-2eee-4f06-af06-453e43832b65 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cbee4e70-0437-4676-9072-9e161d3d2ff6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:36 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bb7d3640-314e-4896-907d-1c20515d6e0e Sep 23 15:27:36 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:37 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e492732-2eaa-4ae0-8f26-42c14386ccc0 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.413s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:37 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-3e492732-2eaa-4ae0-8f26-42c14386ccc0 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:37 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-3e492732-2eaa-4ae0-8f26-42c14386ccc0 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Deleted volume successfully. Sep 23 15:27:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3e492732-2eaa-4ae0-8f26-42c14386ccc0 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-e4e653c0-fc54-44d4-b6e6-476e74705459-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:37 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cbee4e70-0437-4676-9072-9e161d3d2ff6 Sep 23 15:27:37 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:37 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5ee56b6b-5511-4b9e-8a06-0baafa81b6df tempest-ProjectReaderTests-1760292137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bb7d3640-314e-4896-907d-1c20515d6e0e" returned: 0 in 0.637s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:37 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5ee56b6b-5511-4b9e-8a06-0baafa81b6df tempest-ProjectReaderTests-1760292137 None] Lock "cinder-quobyte-bb7d3640-314e-4896-907d-1c20515d6e0e" released by "delete_volume" :: held 1.421s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:37 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-5ee56b6b-5511-4b9e-8a06-0baafa81b6df tempest-ProjectReaderTests-1760292137 None] Created reservations ['6a47f7b3-8d85-4ee0-a189-84c73ca1effd', '2cc6e6bf-f4ed-4679-a505-4633f0045214', 'af9a0fec-42ac-4f86-bbc7-9b9075419eef', '59c653c3-4314-4df5-aeae-054af558eeef'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5ee56b6b-5511-4b9e-8a06-0baafa81b6df tempest-ProjectReaderTests-1760292137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5ee56b6b-5511-4b9e-8a06-0baafa81b6df tempest-ProjectReaderTests-1760292137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:37 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5ee56b6b-5511-4b9e-8a06-0baafa81b6df tempest-ProjectReaderTests-1760292137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:37 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5ee56b6b-5511-4b9e-8a06-0baafa81b6df tempest-ProjectReaderTests-1760292137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5ee56b6b-5511-4b9e-8a06-0baafa81b6df tempest-ProjectReaderTests-1760292137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5ee56b6b-5511-4b9e-8a06-0baafa81b6df tempest-ProjectReaderTests-1760292137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:37 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5360346d-2eee-4f06-af06-453e43832b65 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cbee4e70-0437-4676-9072-9e161d3d2ff6" returned: 0 in 1.056s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5360346d-2eee-4f06-af06-453e43832b65 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cbee4e70-0437-4676-9072-9e161d3d2ff6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:38 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:38 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:38 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cbee4e70-0437-4676-9072-9e161d3d2ff6 Sep 23 15:27:38 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:38 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5ee56b6b-5511-4b9e-8a06-0baafa81b6df tempest-ProjectReaderTests-1760292137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.413s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:38 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-5ee56b6b-5511-4b9e-8a06-0baafa81b6df tempest-ProjectReaderTests-1760292137 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:38 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5ee56b6b-5511-4b9e-8a06-0baafa81b6df tempest-ProjectReaderTests-1760292137 None] Deleted volume successfully. Sep 23 15:27:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5ee56b6b-5511-4b9e-8a06-0baafa81b6df tempest-ProjectReaderTests-1760292137 None] Lock "cinder-bb7d3640-314e-4896-907d-1c20515d6e0e-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:38 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5360346d-2eee-4f06-af06-453e43832b65 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-cbee4e70-0437-4676-9072-9e161d3d2ff6" returned: 0 in 0.609s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5360346d-2eee-4f06-af06-453e43832b65 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-quobyte-cbee4e70-0437-4676-9072-9e161d3d2ff6" released by "delete_volume" :: held 1.807s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:38 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-5360346d-2eee-4f06-af06-453e43832b65 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Created reservations ['5d589b8d-df5f-4fe4-82b7-78e0ceb14c57', '4e439926-a5fb-423f-8fca-1f624e062cdc', 'afcca7fb-e28b-40ff-8edc-e6b27f2b13d6', 'f198c0b6-d0cb-49a3-8dca-8eb2889ea4c3'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5360346d-2eee-4f06-af06-453e43832b65 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5360346d-2eee-4f06-af06-453e43832b65 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5360346d-2eee-4f06-af06-453e43832b65 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5360346d-2eee-4f06-af06-453e43832b65 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5360346d-2eee-4f06-af06-453e43832b65 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5360346d-2eee-4f06-af06-453e43832b65 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:39 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:39 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-52fcb19c-9c71-4f25-b3b7-ddca0022a6cd tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "cinder-d00df9d0-bb89-4876-a64d-8a8c36b5dfaa-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-52fcb19c-9c71-4f25-b3b7-ddca0022a6cd tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-d00df9d0-bb89-4876-a64d-8a8c36b5dfaa-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-52fcb19c-9c71-4f25-b3b7-ddca0022a6cd tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "cinder-quobyte-d00df9d0-bb89-4876-a64d-8a8c36b5dfaa" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-52fcb19c-9c71-4f25-b3b7-ddca0022a6cd tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-quobyte-d00df9d0-bb89-4876-a64d-8a8c36b5dfaa" acquired by "delete_volume" :: waited 0.045s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:39 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:39 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Flow 'volume_create_manager' (1e7e0a28-4a03-4792-b6bd-28479d9807b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33bc962f-b6bf-4d54-9de3-fb832db6cead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:39 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f44216-319e-4620-b47c-19871834cac2]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-52fcb19c-9c71-4f25-b3b7-ddca0022a6cd tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d00df9d0-bb89-4876-a64d-8a8c36b5dfaa {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5360346d-2eee-4f06-af06-453e43832b65 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.779s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:39 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-5360346d-2eee-4f06-af06-453e43832b65 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:39 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5360346d-2eee-4f06-af06-453e43832b65 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Deleted volume successfully. Sep 23 15:27:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33bc962f-b6bf-4d54-9de3-fb832db6cead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1018686919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c9bbcf-ebaf-4314-8fa1-62d54d9a9179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbceb64ac6814047a26a6f304e568f2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:40Z,use_quota=True,user_id='aee5096b35d64a66891fa411075b5472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc89cde-c8eb-473c-b623-2b89d5045c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc89cde-c8eb-473c-b623-2b89d5045c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6c645b-7477-4ec5-97c3-e3bac2e182b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:39 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d00df9d0-bb89-4876-a64d-8a8c36b5dfaa Sep 23 15:27:39 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6c645b-7477-4ec5-97c3-e3bac2e182b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28c9bbcf-ebaf-4314-8fa1-62d54d9a9179', 'volume_name': 'volume-28c9bbcf-ebaf-4314-8fa1-62d54d9a9179', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf9eaa6-507a-498e-99a1-48be596380ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf9eaa6-507a-498e-99a1-48be596380ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa09d8d-aaad-4c68-85a9-f413043831bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:39 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Volume 28c9bbcf-ebaf-4314-8fa1-62d54d9a9179: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28c9bbcf-ebaf-4314-8fa1-62d54d9a9179', 'volume_size': 1} Sep 23 15:27:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:40 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5360346d-2eee-4f06-af06-453e43832b65 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-cbee4e70-0437-4676-9072-9e161d3d2ff6-delete_volume" released by "delete_volume" :: held 3.275s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:40 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-52fcb19c-9c71-4f25-b3b7-ddca0022a6cd tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d00df9d0-bb89-4876-a64d-8a8c36b5dfaa" returned: 0 in 0.820s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-52fcb19c-9c71-4f25-b3b7-ddca0022a6cd tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d00df9d0-bb89-4876-a64d-8a8c36b5dfaa {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:40 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d00df9d0-bb89-4876-a64d-8a8c36b5dfaa Sep 23 15:27:40 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:41 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-52fcb19c-9c71-4f25-b3b7-ddca0022a6cd tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-d00df9d0-bb89-4876-a64d-8a8c36b5dfaa" returned: 0 in 0.649s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-52fcb19c-9c71-4f25-b3b7-ddca0022a6cd tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-quobyte-d00df9d0-bb89-4876-a64d-8a8c36b5dfaa" released by "delete_volume" :: held 1.675s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:41 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-52fcb19c-9c71-4f25-b3b7-ddca0022a6cd tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Created reservations ['f8e70681-4fe9-4bc5-8f6a-56f6204ef707', '8a0ba5f4-1551-46a0-b4e8-4202c7feb436', '4e734536-0db8-4cf7-a41a-a3a67f673690', '1e43efb5-8015-4604-beda-996b978bce31'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-52fcb19c-9c71-4f25-b3b7-ddca0022a6cd tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-52fcb19c-9c71-4f25-b3b7-ddca0022a6cd tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:41 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-52fcb19c-9c71-4f25-b3b7-ddca0022a6cd tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:41 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-52fcb19c-9c71-4f25-b3b7-ddca0022a6cd tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-52fcb19c-9c71-4f25-b3b7-ddca0022a6cd tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-52fcb19c-9c71-4f25-b3b7-ddca0022a6cd tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:41 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:41 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1b0c0918-52db-44bb-ac50-89c5d2b0c112 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "cinder-c12ad5cb-a3a1-4e7b-95c1-94110714312a-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1b0c0918-52db-44bb-ac50-89c5d2b0c112 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-c12ad5cb-a3a1-4e7b-95c1-94110714312a-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:42 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1b0c0918-52db-44bb-ac50-89c5d2b0c112 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "cinder-quobyte-c12ad5cb-a3a1-4e7b-95c1-94110714312a" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:42 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1b0c0918-52db-44bb-ac50-89c5d2b0c112 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-quobyte-c12ad5cb-a3a1-4e7b-95c1-94110714312a" acquired by "delete_volume" :: waited 0.037s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:42 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-52fcb19c-9c71-4f25-b3b7-ddca0022a6cd tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.564s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:42 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-52fcb19c-9c71-4f25-b3b7-ddca0022a6cd tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:42 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-52fcb19c-9c71-4f25-b3b7-ddca0022a6cd tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Deleted volume successfully. Sep 23 15:27:42 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[26681978-573d-4178-8eed-518fa0942082]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1b0c0918-52db-44bb-ac50-89c5d2b0c112 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c12ad5cb-a3a1-4e7b-95c1-94110714312a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:42 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-52fcb19c-9c71-4f25-b3b7-ddca0022a6cd tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-d00df9d0-bb89-4876-a64d-8a8c36b5dfaa-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:42 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c12ad5cb-a3a1-4e7b-95c1-94110714312a Sep 23 15:27:42 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:42 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:42 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Flow 'volume_create_manager' (e69937d5-d1b8-4e1d-b41b-e1b963d3f656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:42 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e934ed-1c1e-4e9d-9502-c69752e03178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:42 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e934ed-1c1e-4e9d-9502-c69752e03178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08797de3-f6bf-4b84-915e-d47109ba3973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d877f8ca7e0a48bca32c78827b8c9cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:42Z,use_quota=True,user_id='29461ee827054a148f939120cf0a38a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:42 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2b63aa-25a4-44cd-b843-bfef682cda10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:42 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2b63aa-25a4-44cd-b843-bfef682cda10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:42 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273c35f8-107e-47c8-9098-934d17620904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:42 devstack cinder-volume[86064]: DEBUG cinder.image.glance [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Creating Keystone auth plugin from conf {{(pid=86064) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 15:27:43 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1b0c0918-52db-44bb-ac50-89c5d2b0c112 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c12ad5cb-a3a1-4e7b-95c1-94110714312a" returned: 0 in 0.845s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1b0c0918-52db-44bb-ac50-89c5d2b0c112 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c12ad5cb-a3a1-4e7b-95c1-94110714312a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:43 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c12ad5cb-a3a1-4e7b-95c1-94110714312a Sep 23 15:27:43 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:43 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273c35f8-107e-47c8-9098-934d17620904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '08797de3-f6bf-4b84-915e-d47109ba3973', 'volume_name': 'volume-08797de3-f6bf-4b84-915e-d47109ba3973', 'volume_size': 1, 'image_id': 'bd03ceb6-89dc-4196-b550-f4946f54dcaf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd03ceb6-89dc-4196-b550-f4946f54dcaf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5bf2ac2f428e1c935552e1fffebf58a0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd877f8ca7e0a48bca32c78827b8c9cfe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3452e7515373f0025fa3712e7d36422616456cc8139c016a5e56b4ebb2f45bc0dcb48c3cbd9aec05207a1a9c3819d7ed302b8cfd287e178309d8283203a8c8ef', 'id': 'bd03ceb6-89dc-4196-b550-f4946f54dcaf', 'created_at': datetime.datetime(2026, 9, 23, 13, 27, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 27, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd03ceb6-89dc-4196-b550-f4946f54dcaf/file', 'properties': {}}, 'image_service': }' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:43 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e2f495-1996-4f11-981b-1268b71f99f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:43 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e2f495-1996-4f11-981b-1268b71f99f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:43 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a24d089-35e8-4519-8199-d547885d6b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:43 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Volume 08797de3-f6bf-4b84-915e-d47109ba3973: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-08797de3-f6bf-4b84-915e-d47109ba3973', 'volume_size': 1, 'image_id': 'bd03ceb6-89dc-4196-b550-f4946f54dcaf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd03ceb6-89dc-4196-b550-f4946f54dcaf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5bf2ac2f428e1c935552e1fffebf58a0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd877f8ca7e0a48bca32c78827b8c9cfe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3452e7515373f0025fa3712e7d36422616456cc8139c016a5e56b4ebb2f45bc0dcb48c3cbd9aec05207a1a9c3819d7ed302b8cfd287e178309d8283203a8c8ef', 'id': 'bd03ceb6-89dc-4196-b550-f4946f54dcaf', 'created_at': datetime.datetime(2026, 9, 23, 13, 27, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 27, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd03ceb6-89dc-4196-b550-f4946f54dcaf/file', 'properties': {}}, 'image_service': } Sep 23 15:27:43 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Trying to clone 08797de3-f6bf-4b84-915e-d47109ba3973 from image bd03ceb6-89dc-4196-b550-f4946f54dcaf at location (None, [{'url': 'file:///opt/stack/data/glance/images/bd03ceb6-89dc-4196-b550-f4946f54dcaf', 'metadata': {}}]). {{(pid=86064) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 15:27:43 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 15:27:43 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Image download 0.00 MB at 0.00 MB/s Sep 23 15:27:43 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1b0c0918-52db-44bb-ac50-89c5d2b0c112 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c12ad5cb-a3a1-4e7b-95c1-94110714312a" returned: 0 in 0.651s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1b0c0918-52db-44bb-ac50-89c5d2b0c112 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-quobyte-c12ad5cb-a3a1-4e7b-95c1-94110714312a" released by "delete_volume" :: held 1.623s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:43 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ffe734-2c54-4d80-8d4d-48bd9741a2bb]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:43 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-1b0c0918-52db-44bb-ac50-89c5d2b0c112 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Created reservations ['9d09223a-aa3f-4cd5-93f9-6e1ce254a549', 'c903acfe-a100-4c91-a825-3b57bb05c9c2', 'ff2e4c3f-a59a-4213-9078-cde44dc14271', '66f35a6e-bc47-4756-84c8-0f80cf25ca89'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:43 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD Sep 23 15:27:43 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1b0c0918-52db-44bb-ac50-89c5d2b0c112 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1b0c0918-52db-44bb-ac50-89c5d2b0c112 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:44 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1b0c0918-52db-44bb-ac50-89c5d2b0c112 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:44 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1b0c0918-52db-44bb-ac50-89c5d2b0c112 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1b0c0918-52db-44bb-ac50-89c5d2b0c112 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1b0c0918-52db-44bb-ac50-89c5d2b0c112 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:44 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:44 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:44 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD" returned: 0 in 0.575s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:44 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1b0c0918-52db-44bb-ac50-89c5d2b0c112 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.447s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:44 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-1b0c0918-52db-44bb-ac50-89c5d2b0c112 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:44 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-1b0c0918-52db-44bb-ac50-89c5d2b0c112 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Deleted volume successfully. Sep 23 15:27:44 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1b0c0918-52db-44bb-ac50-89c5d2b0c112 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-c12ad5cb-a3a1-4e7b-95c1-94110714312a-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:44 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD Sep 23 15:27:44 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:44 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-867f1980-236a-456e-9ac9-e1f423e23743 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "cinder-c0804999-76e4-4eec-934b-6c91222c7667-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:44 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-867f1980-236a-456e-9ac9-e1f423e23743 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-c0804999-76e4-4eec-934b-6c91222c7667-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:44 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-867f1980-236a-456e-9ac9-e1f423e23743 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "cinder-quobyte-c0804999-76e4-4eec-934b-6c91222c7667" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:44 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD" returned: 1 in 0.545s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:27:44 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Temporary image bd03ceb6-89dc-4196-b550-f4946f54dcaf is fetched for user 29461ee827054a148f939120cf0a38a3. {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 15:27:44 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-867f1980-236a-456e-9ac9-e1f423e23743 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-quobyte-c0804999-76e4-4eec-934b-6c91222c7667" acquired by "delete_volume" :: waited 0.050s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:44 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70a900a-a6ac-46a8-9187-f3e6fb030fd8]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-867f1980-236a-456e-9ac9-e1f423e23743 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c0804999-76e4-4eec-934b-6c91222c7667 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9b0607-21ed-4efa-aaa7-7d8e7f07062d]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:45 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5a043df-b425-4585-9b83-f74badf63117" returned: 0 in 9.080s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a, size 1024.00 MB, duration 9.08 sec, destination /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5a043df-b425-4585-9b83-f74badf63117 {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:27:45 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Converted 1024.00 MB image at 112.76 MB/s Sep 23 15:27:45 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5a043df-b425-4585-9b83-f74badf63117 is being set with open permissions: ugo+rw Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5a043df-b425-4585-9b83-f74badf63117 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:45 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5a043df-b425-4585-9b83-f74badf63117 Sep 23 15:27:45 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:45 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c0804999-76e4-4eec-934b-6c91222c7667 Sep 23 15:27:45 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:45 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD Sep 23 15:27:45 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:45 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5a043df-b425-4585-9b83-f74badf63117" returned: 0 in 0.272s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Lock "cinder-quobyte-a5a043df-b425-4585-9b83-f74badf63117" released by "_copy_volume_from_snapshot" :: held 10.494s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:45 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-867f1980-236a-456e-9ac9-e1f423e23743 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c0804999-76e4-4eec-934b-6c91222c7667" returned: 0 in 0.430s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-867f1980-236a-456e-9ac9-e1f423e23743 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c0804999-76e4-4eec-934b-6c91222c7667 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Lock "cinder-quobyte-1363706d-3316-4c35-a00e-c209ae4623b8-a5a043df-b425-4585-9b83-f74badf63117" released by "_create_volume_from_snapshot" :: held 10.595s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.636s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:45 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c0804999-76e4-4eec-934b-6c91222c7667 Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.451s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:45 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1018686919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c9bbcf-ebaf-4314-8fa1-62d54d9a9179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbceb64ac6814047a26a6f304e568f2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:40Z,use_quota=True,user_id='aee5096b35d64a66891fa411075b5472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Creating volume 28c9bbcf-ebaf-4314-8fa1-62d54d9a9179 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:45 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:45 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28c9bbcf-ebaf-4314-8fa1-62d54d9a9179 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD" returned: 0 in 0.420s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:45 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28c9bbcf-ebaf-4314-8fa1-62d54d9a9179 1073741824 Sep 23 15:27:45 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d11d61d-485a-44ce-a266-81bf593ab19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5a043df-b425-4585-9b83-f74badf63117', 'volume_size': 1, 'snapshot_id': '1363706d-3316-4c35-a00e-c209ae4623b8'}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2364bb7-7612-4a59-ae13-bc5ee50a9fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:45 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Volume volume-a5a043df-b425-4585-9b83-f74badf63117 (a5a043df-b425-4585-9b83-f74badf63117): created successfully Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2364bb7-7612-4a59-ae13-bc5ee50a9fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Flow 'volume_create_manager' (4268438a-2f1d-4b9c-99c3-be0674fd05a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:45 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-d16aef3a-2a9f-4efd-a44a-c3bb5c2eef58 tempest-VolumeDependencyTests-998585106 None] Created volume successfully. Sep 23 15:27:45 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD Sep 23 15:27:45 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:45 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-867f1980-236a-456e-9ac9-e1f423e23743 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-c0804999-76e4-4eec-934b-6c91222c7667" returned: 0 in 0.262s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-867f1980-236a-456e-9ac9-e1f423e23743 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-quobyte-c0804999-76e4-4eec-934b-6c91222c7667" released by "delete_volume" :: held 0.780s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-867f1980-236a-456e-9ac9-e1f423e23743 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Created reservations ['2fccaa2d-d22a-47cd-a711-cdbc7d837ac8', '676b9363-f500-41df-8345-3f3c1da0b0d8', '1e00ba12-aefe-42a5-b0fa-53d841edc8e8', '9cec7daf-3f7e-4bfd-acbb-6528b1ab3943'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-867f1980-236a-456e-9ac9-e1f423e23743 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-867f1980-236a-456e-9ac9-e1f423e23743 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-867f1980-236a-456e-9ac9-e1f423e23743 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-867f1980-236a-456e-9ac9-e1f423e23743 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-867f1980-236a-456e-9ac9-e1f423e23743 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-867f1980-236a-456e-9ac9-e1f423e23743 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:45 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:45 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:45 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD" returned: 1 in 0.385s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:45 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28c9bbcf-ebaf-4314-8fa1-62d54d9a9179 1073741824" returned: 0 in 0.564s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28c9bbcf-ebaf-4314-8fa1-62d54d9a9179 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:46 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28c9bbcf-ebaf-4314-8fa1-62d54d9a9179 Sep 23 15:27:46 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:46 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-867f1980-236a-456e-9ac9-e1f423e23743 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.276s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-867f1980-236a-456e-9ac9-e1f423e23743 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:46 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-867f1980-236a-456e-9ac9-e1f423e23743 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Deleted volume successfully. Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-867f1980-236a-456e-9ac9-e1f423e23743 tempest-CreateVolumesFromSourceVolumeTest-1615856592 None] Lock "cinder-c0804999-76e4-4eec-934b-6c91222c7667-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:46 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28c9bbcf-ebaf-4314-8fa1-62d54d9a9179" returned: 0 in 0.281s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.485s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08797de3-f6bf-4b84-915e-d47109ba3973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d877f8ca7e0a48bca32c78827b8c9cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:42Z,use_quota=True,user_id='29461ee827054a148f939120cf0a38a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Creating volume 08797de3-f6bf-4b84-915e-d47109ba3973 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:46 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-08797de3-f6bf-4b84-915e-d47109ba3973 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa09d8d-aaad-4c68-85a9-f413043831bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28c9bbcf-ebaf-4314-8fa1-62d54d9a9179', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:46 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-08797de3-f6bf-4b84-915e-d47109ba3973 1073741824 Sep 23 15:27:46 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f00144d-5b88-4a2b-9371-2fd0cf3d5319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:46 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Volume volume-28c9bbcf-ebaf-4314-8fa1-62d54d9a9179 (28c9bbcf-ebaf-4314-8fa1-62d54d9a9179): created successfully Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f00144d-5b88-4a2b-9371-2fd0cf3d5319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Flow 'volume_create_manager' (1e7e0a28-4a03-4792-b6bd-28479d9807b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:46 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-61c7b7df-b6c2-41c0-8ef8-ace051a8673f tempest-ProjectReaderTests-1760292137 None] Created volume successfully. Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bef53a63-ba30-43db-9911-9d71f9202c18 tempest-VolumeDependencyTests-998585106 None] Acquiring lock "cinder-1363706d-3316-4c35-a00e-c209ae4623b8-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bef53a63-ba30-43db-9911-9d71f9202c18 tempest-VolumeDependencyTests-998585106 None] Lock "cinder-1363706d-3316-4c35-a00e-c209ae4623b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bef53a63-ba30-43db-9911-9d71f9202c18 tempest-VolumeDependencyTests-998585106 None] Acquiring lock "cinder-quobyte-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bef53a63-ba30-43db-9911-9d71f9202c18 tempest-VolumeDependencyTests-998585106 None] Lock "cinder-quobyte-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bef53a63-ba30-43db-9911-9d71f9202c18 tempest-VolumeDependencyTests-998585106 None] Acquiring lock "cinder-quobyte-1363706d-3316-4c35-a00e-c209ae4623b8" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bef53a63-ba30-43db-9911-9d71f9202c18 tempest-VolumeDependencyTests-998585106 None] Lock "cinder-quobyte-1363706d-3316-4c35-a00e-c209ae4623b8" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-bef53a63-ba30-43db-9911-9d71f9202c18 tempest-VolumeDependencyTests-998585106 None] Deleting offline snapshot 1363706d-3316-4c35-a00e-c209ae4623b8 of volume 70feb9da-e0b4-4d9c-a674-5e7119d1bb6a {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-bef53a63-ba30-43db-9911-9d71f9202c18 tempest-VolumeDependencyTests-998585106 None] snapshot_file for this snap is: volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d23c7a3-a85d-4572-a2db-442069c20e60]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bef53a63-ba30-43db-9911-9d71f9202c18 tempest-VolumeDependencyTests-998585106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:46 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8 Sep 23 15:27:46 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:46 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-08797de3-f6bf-4b84-915e-d47109ba3973 1073741824" returned: 0 in 0.548s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-08797de3-f6bf-4b84-915e-d47109ba3973 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:46 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-08797de3-f6bf-4b84-915e-d47109ba3973 Sep 23 15:27:46 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:47 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bef53a63-ba30-43db-9911-9d71f9202c18 tempest-VolumeDependencyTests-998585106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8" returned: 0 in 0.476s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:47 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-bef53a63-ba30-43db-9911-9d71f9202c18 tempest-VolumeDependencyTests-998585106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:27:47 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba94346-2f6c-4993-b8fe-7b7e76a6d9c4]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bef53a63-ba30-43db-9911-9d71f9202c18 tempest-VolumeDependencyTests-998585106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:47 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-98c3ac78-4199-4273-bf89-b3477d748c33 tempest-ProjectReaderTests-1760292137 None] Acquiring lock "cinder-28c9bbcf-ebaf-4314-8fa1-62d54d9a9179-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:47 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-08797de3-f6bf-4b84-915e-d47109ba3973" returned: 0 in 0.319s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:47 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:47 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-98c3ac78-4199-4273-bf89-b3477d748c33 tempest-ProjectReaderTests-1760292137 None] Lock "cinder-28c9bbcf-ebaf-4314-8fa1-62d54d9a9179-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:47 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Attempting download of bd03ceb6-89dc-4196-b550-f4946f54dcaf ((None, [{'url': 'file:///opt/stack/data/glance/images/bd03ceb6-89dc-4196-b550-f4946f54dcaf', 'metadata': {}}])) to volume 08797de3-f6bf-4b84-915e-d47109ba3973. {{(pid=86064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 15:27:47 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-98c3ac78-4199-4273-bf89-b3477d748c33 tempest-ProjectReaderTests-1760292137 None] Acquiring lock "cinder-quobyte-28c9bbcf-ebaf-4314-8fa1-62d54d9a9179" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:47 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a Sep 23 15:27:47 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:47 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-98c3ac78-4199-4273-bf89-b3477d748c33 tempest-ProjectReaderTests-1760292137 None] Lock "cinder-quobyte-28c9bbcf-ebaf-4314-8fa1-62d54d9a9179" acquired by "delete_volume" :: waited 0.026s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:47 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f34811b-3dc2-4b40-8817-38c887f42e0b]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98c3ac78-4199-4273-bf89-b3477d748c33 tempest-ProjectReaderTests-1760292137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28c9bbcf-ebaf-4314-8fa1-62d54d9a9179 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:47 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[818d8636-2283-4f4f-8581-d7bfadfbe902]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd03ceb6-89dc-4196-b550-f4946f54dcaf_gc8jyh5l {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:47 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd03ceb6-89dc-4196-b550-f4946f54dcaf_gc8jyh5l Sep 23 15:27:47 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:47 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28c9bbcf-ebaf-4314-8fa1-62d54d9a9179 Sep 23 15:27:47 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:47 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd03ceb6-89dc-4196-b550-f4946f54dcaf_gc8jyh5l" returned: 0 in 0.424s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd03ceb6-89dc-4196-b550-f4946f54dcaf_gc8jyh5l {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:47 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bef53a63-ba30-43db-9911-9d71f9202c18 tempest-VolumeDependencyTests-998585106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a" returned: 0 in 0.699s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bef53a63-ba30-43db-9911-9d71f9202c18 tempest-VolumeDependencyTests-998585106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:47 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98c3ac78-4199-4273-bf89-b3477d748c33 tempest-ProjectReaderTests-1760292137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28c9bbcf-ebaf-4314-8fa1-62d54d9a9179" returned: 0 in 0.512s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98c3ac78-4199-4273-bf89-b3477d748c33 tempest-ProjectReaderTests-1760292137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28c9bbcf-ebaf-4314-8fa1-62d54d9a9179 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:47 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8 Sep 23 15:27:47 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:47 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28c9bbcf-ebaf-4314-8fa1-62d54d9a9179 Sep 23 15:27:47 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:48 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd03ceb6-89dc-4196-b550-f4946f54dcaf_gc8jyh5l Sep 23 15:27:48 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:48 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98c3ac78-4199-4273-bf89-b3477d748c33 tempest-ProjectReaderTests-1760292137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28c9bbcf-ebaf-4314-8fa1-62d54d9a9179" returned: 0 in 0.290s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-98c3ac78-4199-4273-bf89-b3477d748c33 tempest-ProjectReaderTests-1760292137 None] Lock "cinder-quobyte-28c9bbcf-ebaf-4314-8fa1-62d54d9a9179" released by "delete_volume" :: held 0.868s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:48 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd03ceb6-89dc-4196-b550-f4946f54dcaf_gc8jyh5l" returned: 1 in 0.429s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd03ceb6-89dc-4196-b550-f4946f54dcaf_gc8jyh5l' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[58353459-72f0-4fc5-8b99-1f3ce0cb9391]: (4, 'raw') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:48 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bef53a63-ba30-43db-9911-9d71f9202c18 tempest-VolumeDependencyTests-998585106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8" returned: 0 in 0.425s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bef53a63-ba30-43db-9911-9d71f9202c18 tempest-VolumeDependencyTests-998585106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-98c3ac78-4199-4273-bf89-b3477d748c33 tempest-ProjectReaderTests-1760292137 None] Created reservations ['4711e2fc-1767-498e-91ff-f9f951f6cb12', 'ce608220-6575-4aa3-86ec-10b6ec2f8745', '9f61c481-1631-457e-a205-7c3f7ac7fab6', 'bbf47781-0404-4489-aceb-ed56b3bfe0cc'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:48 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8 Sep 23 15:27:48 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-98c3ac78-4199-4273-bf89-b3477d748c33 tempest-ProjectReaderTests-1760292137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-98c3ac78-4199-4273-bf89-b3477d748c33 tempest-ProjectReaderTests-1760292137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-98c3ac78-4199-4273-bf89-b3477d748c33 tempest-ProjectReaderTests-1760292137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-98c3ac78-4199-4273-bf89-b3477d748c33 tempest-ProjectReaderTests-1760292137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-98c3ac78-4199-4273-bf89-b3477d748c33 tempest-ProjectReaderTests-1760292137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98c3ac78-4199-4273-bf89-b3477d748c33 tempest-ProjectReaderTests-1760292137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:48 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD Sep 23 15:27:48 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:48 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:48 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:48 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bef53a63-ba30-43db-9911-9d71f9202c18 tempest-VolumeDependencyTests-998585106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a.1363706d-3316-4c35-a00e-c209ae4623b8" returned: 0 in 0.348s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bef53a63-ba30-43db-9911-9d71f9202c18 tempest-VolumeDependencyTests-998585106 None] Lock "cinder-quobyte-1363706d-3316-4c35-a00e-c209ae4623b8" released by "_delete_snapshot" :: held 2.095s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:48 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bef53a63-ba30-43db-9911-9d71f9202c18 tempest-VolumeDependencyTests-998585106 None] Lock "cinder-quobyte-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a" released by "delete_snapshot" :: held 2.137s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD" returned: 0 in 0.439s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:48 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-98c3ac78-4199-4273-bf89-b3477d748c33 tempest-ProjectReaderTests-1760292137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.320s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-98c3ac78-4199-4273-bf89-b3477d748c33 tempest-ProjectReaderTests-1760292137 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:48 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-98c3ac78-4199-4273-bf89-b3477d748c33 tempest-ProjectReaderTests-1760292137 None] Deleted volume successfully. Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-98c3ac78-4199-4273-bf89-b3477d748c33 tempest-ProjectReaderTests-1760292137 None] Lock "cinder-28c9bbcf-ebaf-4314-8fa1-62d54d9a9179-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-bef53a63-ba30-43db-9911-9d71f9202c18 tempest-VolumeDependencyTests-998585106 None] Created reservations ['0b3e08c1-48a5-4bdc-a497-5e907e239a2e', '41ad82aa-c0c2-4269-80d4-147b3d6c7bd4', '804802cb-786e-451c-9bca-c46d1ab6cdd5', '93ce4799-4e8c-4431-ad9f-eb166cf1df8f'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:48 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD Sep 23 15:27:48 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:48 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-bef53a63-ba30-43db-9911-9d71f9202c18 tempest-VolumeDependencyTests-998585106 None] Delete snapshot completed successfully. Sep 23 15:27:48 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bef53a63-ba30-43db-9911-9d71f9202c18 tempest-VolumeDependencyTests-998585106 None] Lock "cinder-1363706d-3316-4c35-a00e-c209ae4623b8-delete_snapshot" released by "delete_snapshot" :: held 2.347s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:49 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD" returned: 1 in 0.365s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD' failed. Not Retrying. {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 15:27:49 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] bd03ceb6-89dc-4196-b550-f4946f54dcaf was raw, converting to qcow2 {{(pid=86064) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 15:27:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-08797de3-f6bf-4b84-915e-d47109ba3973 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:49 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-08797de3-f6bf-4b84-915e-d47109ba3973 Sep 23 15:27:49 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:49 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-08797de3-f6bf-4b84-915e-d47109ba3973" returned: 0 in 0.533s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:49 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bd03ceb6-89dc-4196-b550-f4946f54dcaf_mifsvn92devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-08797de3-f6bf-4b84-915e-d47109ba3973 {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:27:49 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 15:27:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-08797de3-f6bf-4b84-915e-d47109ba3973 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:49 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-08797de3-f6bf-4b84-915e-d47109ba3973 1G Sep 23 15:27:49 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3424d1af-67a0-4a43-a37d-a7462d09fc5f tempest-VolumeDependencyTests-998585106 None] Acquiring lock "cinder-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3424d1af-67a0-4a43-a37d-a7462d09fc5f tempest-VolumeDependencyTests-998585106 None] Lock "cinder-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3424d1af-67a0-4a43-a37d-a7462d09fc5f tempest-VolumeDependencyTests-998585106 None] Acquiring lock "cinder-quobyte-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3424d1af-67a0-4a43-a37d-a7462d09fc5f tempest-VolumeDependencyTests-998585106 None] Lock "cinder-quobyte-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a" acquired by "delete_volume" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:49 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[288068b8-1600-406b-92f6-0b92f29e283d]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3424d1af-67a0-4a43-a37d-a7462d09fc5f tempest-VolumeDependencyTests-998585106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:50 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-08797de3-f6bf-4b84-915e-d47109ba3973 1G" returned: 0 in 0.446s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:50 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Downloaded image bd03ceb6-89dc-4196-b550-f4946f54dcaf ((None, [{'url': 'file:///opt/stack/data/glance/images/bd03ceb6-89dc-4196-b550-f4946f54dcaf', 'metadata': {}}])) to volume 08797de3-f6bf-4b84-915e-d47109ba3973 successfully. {{(pid=86064) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 15:27:50 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Temporary image bd03ceb6-89dc-4196-b550-f4946f54dcaf for user 29461ee827054a148f939120cf0a38a3 is deleted. {{(pid=86064) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 15:27:50 devstack cinder-volume[86064]: DEBUG cinder.volume.volume_utils [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Marking volume 08797de3-f6bf-4b84-915e-d47109ba3973 as bootable. {{(pid=86064) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 15:27:50 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a Sep 23 15:27:50 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:50 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Copying metadata from image bd03ceb6-89dc-4196-b550-f4946f54dcaf to 08797de3-f6bf-4b84-915e-d47109ba3973. {{(pid=86064) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 15:27:50 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Creating volume glance metadata for volume 08797de3-f6bf-4b84-915e-d47109ba3973 backed by image bd03ceb6-89dc-4196-b550-f4946f54dcaf with: {'image_id': 'bd03ceb6-89dc-4196-b550-f4946f54dcaf', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5bf2ac2f428e1c935552e1fffebf58a0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86064) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 15:27:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a24d089-35e8-4519-8199-d547885d6b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08797de3-f6bf-4b84-915e-d47109ba3973', 'volume_size': 1, 'image_id': 'bd03ceb6-89dc-4196-b550-f4946f54dcaf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd03ceb6-89dc-4196-b550-f4946f54dcaf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5bf2ac2f428e1c935552e1fffebf58a0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd877f8ca7e0a48bca32c78827b8c9cfe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3452e7515373f0025fa3712e7d36422616456cc8139c016a5e56b4ebb2f45bc0dcb48c3cbd9aec05207a1a9c3819d7ed302b8cfd287e178309d8283203a8c8ef', 'id': 'bd03ceb6-89dc-4196-b550-f4946f54dcaf', 'created_at': datetime.datetime(2026, 9, 23, 13, 27, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 13, 27, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd03ceb6-89dc-4196-b550-f4946f54dcaf/file', 'properties': {}}, 'image_service': }' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3bc0da-c42f-4042-9a03-4f30b3666dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:50 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Volume volume-08797de3-f6bf-4b84-915e-d47109ba3973 (08797de3-f6bf-4b84-915e-d47109ba3973): created successfully Sep 23 15:27:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3bc0da-c42f-4042-9a03-4f30b3666dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Flow 'volume_create_manager' (e69937d5-d1b8-4e1d-b41b-e1b963d3f656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:50 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7286e637-038f-4db2-bd9f-e4843eef9cbd tempest-VolumeImageDependencyTests-1631845072 None] Created volume successfully. Sep 23 15:27:50 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3424d1af-67a0-4a43-a37d-a7462d09fc5f tempest-VolumeDependencyTests-998585106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a" returned: 0 in 0.427s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3424d1af-67a0-4a43-a37d-a7462d09fc5f tempest-VolumeDependencyTests-998585106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:50 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a Sep 23 15:27:50 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:50 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3424d1af-67a0-4a43-a37d-a7462d09fc5f tempest-VolumeDependencyTests-998585106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a" returned: 0 in 0.272s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:50 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3424d1af-67a0-4a43-a37d-a7462d09fc5f tempest-VolumeDependencyTests-998585106 None] Lock "cinder-quobyte-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a" released by "delete_volume" :: held 0.800s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:50 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-3424d1af-67a0-4a43-a37d-a7462d09fc5f tempest-VolumeDependencyTests-998585106 None] Created reservations ['d7d30d39-dc66-4b1c-9075-b97e80b76ab4', '3f2b47e3-7e65-4f8b-942b-205af9f5dde4', 'b8d5f8d0-7afd-4874-8527-66e88589c04e', '43a54fc8-c9be-4df2-b2b2-7900177defda'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3424d1af-67a0-4a43-a37d-a7462d09fc5f tempest-VolumeDependencyTests-998585106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3424d1af-67a0-4a43-a37d-a7462d09fc5f tempest-VolumeDependencyTests-998585106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:50 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3424d1af-67a0-4a43-a37d-a7462d09fc5f tempest-VolumeDependencyTests-998585106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:50 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3424d1af-67a0-4a43-a37d-a7462d09fc5f tempest-VolumeDependencyTests-998585106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3424d1af-67a0-4a43-a37d-a7462d09fc5f tempest-VolumeDependencyTests-998585106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3424d1af-67a0-4a43-a37d-a7462d09fc5f tempest-VolumeDependencyTests-998585106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:50 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:50 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:51 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e0be788d-fd50-4c2a-b44a-100c8e0392aa tempest-VolumeDependencyTests-998585106 None] Acquiring lock "cinder-a5a043df-b425-4585-9b83-f74badf63117-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:51 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e0be788d-fd50-4c2a-b44a-100c8e0392aa tempest-VolumeDependencyTests-998585106 None] Lock "cinder-a5a043df-b425-4585-9b83-f74badf63117-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:51 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e0be788d-fd50-4c2a-b44a-100c8e0392aa tempest-VolumeDependencyTests-998585106 None] Acquiring lock "cinder-quobyte-a5a043df-b425-4585-9b83-f74badf63117" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:51 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e0be788d-fd50-4c2a-b44a-100c8e0392aa tempest-VolumeDependencyTests-998585106 None] Lock "cinder-quobyte-a5a043df-b425-4585-9b83-f74badf63117" acquired by "delete_volume" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:51 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3424d1af-67a0-4a43-a37d-a7462d09fc5f tempest-VolumeDependencyTests-998585106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.391s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:51 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-3424d1af-67a0-4a43-a37d-a7462d09fc5f tempest-VolumeDependencyTests-998585106 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:51 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-3424d1af-67a0-4a43-a37d-a7462d09fc5f tempest-VolumeDependencyTests-998585106 None] Deleted volume successfully. Sep 23 15:27:51 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aee296d-c22c-4a31-8061-a88698e7dc95]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e0be788d-fd50-4c2a-b44a-100c8e0392aa tempest-VolumeDependencyTests-998585106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5a043df-b425-4585-9b83-f74badf63117 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:51 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3424d1af-67a0-4a43-a37d-a7462d09fc5f tempest-VolumeDependencyTests-998585106 None] Lock "cinder-70feb9da-e0b4-4d9c-a674-5e7119d1bb6a-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:51 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-67dad269-baa4-415a-9d3c-776245f9a0b0 tempest-VolumeImageDependencyTests-1631845072 None] Acquiring lock "cinder-08797de3-f6bf-4b84-915e-d47109ba3973-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:51 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-67dad269-baa4-415a-9d3c-776245f9a0b0 tempest-VolumeImageDependencyTests-1631845072 None] Lock "cinder-08797de3-f6bf-4b84-915e-d47109ba3973-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:51 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5a043df-b425-4585-9b83-f74badf63117 Sep 23 15:27:51 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-67dad269-baa4-415a-9d3c-776245f9a0b0 tempest-VolumeImageDependencyTests-1631845072 None] Acquiring lock "cinder-quobyte-08797de3-f6bf-4b84-915e-d47109ba3973" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:27:51 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:51 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-67dad269-baa4-415a-9d3c-776245f9a0b0 tempest-VolumeImageDependencyTests-1631845072 None] Lock "cinder-quobyte-08797de3-f6bf-4b84-915e-d47109ba3973" acquired by "delete_volume" :: waited 0.030s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:27:51 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f94f2d-a607-4e05-8192-7bcb6dd723c1]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:27:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-67dad269-baa4-415a-9d3c-776245f9a0b0 tempest-VolumeImageDependencyTests-1631845072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-08797de3-f6bf-4b84-915e-d47109ba3973 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:51 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-08797de3-f6bf-4b84-915e-d47109ba3973 Sep 23 15:27:51 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:51 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e0be788d-fd50-4c2a-b44a-100c8e0392aa tempest-VolumeDependencyTests-998585106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5a043df-b425-4585-9b83-f74badf63117" returned: 0 in 0.510s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e0be788d-fd50-4c2a-b44a-100c8e0392aa tempest-VolumeDependencyTests-998585106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5a043df-b425-4585-9b83-f74badf63117 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:51 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5a043df-b425-4585-9b83-f74badf63117 Sep 23 15:27:51 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:51 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-67dad269-baa4-415a-9d3c-776245f9a0b0 tempest-VolumeImageDependencyTests-1631845072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-08797de3-f6bf-4b84-915e-d47109ba3973" returned: 0 in 0.435s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-67dad269-baa4-415a-9d3c-776245f9a0b0 tempest-VolumeImageDependencyTests-1631845072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-08797de3-f6bf-4b84-915e-d47109ba3973 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:52 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-08797de3-f6bf-4b84-915e-d47109ba3973 Sep 23 15:27:52 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:52 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e0be788d-fd50-4c2a-b44a-100c8e0392aa tempest-VolumeDependencyTests-998585106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-a5a043df-b425-4585-9b83-f74badf63117" returned: 0 in 0.305s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:52 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e0be788d-fd50-4c2a-b44a-100c8e0392aa tempest-VolumeDependencyTests-998585106 None] Lock "cinder-quobyte-a5a043df-b425-4585-9b83-f74badf63117" released by "delete_volume" :: held 0.910s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:52 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-e0be788d-fd50-4c2a-b44a-100c8e0392aa tempest-VolumeDependencyTests-998585106 None] Created reservations ['fbc16839-89e4-4e3b-a9b2-6b6062d7abb8', '56df9f13-fd81-4e21-9a61-0a3292b2ab96', '55bd6ee2-e1c7-4e2d-8ef7-91ba47bc8dcd', '7260d6a5-46de-4ce6-b0c2-96a8ec06c1ae'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:52 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-67dad269-baa4-415a-9d3c-776245f9a0b0 tempest-VolumeImageDependencyTests-1631845072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-08797de3-f6bf-4b84-915e-d47109ba3973" returned: 0 in 0.328s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:52 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-67dad269-baa4-415a-9d3c-776245f9a0b0 tempest-VolumeImageDependencyTests-1631845072 None] Lock "cinder-quobyte-08797de3-f6bf-4b84-915e-d47109ba3973" released by "delete_volume" :: held 0.833s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e0be788d-fd50-4c2a-b44a-100c8e0392aa tempest-VolumeDependencyTests-998585106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e0be788d-fd50-4c2a-b44a-100c8e0392aa tempest-VolumeDependencyTests-998585106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e0be788d-fd50-4c2a-b44a-100c8e0392aa tempest-VolumeDependencyTests-998585106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-e0be788d-fd50-4c2a-b44a-100c8e0392aa tempest-VolumeDependencyTests-998585106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e0be788d-fd50-4c2a-b44a-100c8e0392aa tempest-VolumeDependencyTests-998585106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e0be788d-fd50-4c2a-b44a-100c8e0392aa tempest-VolumeDependencyTests-998585106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:52 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:52 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:52 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-67dad269-baa4-415a-9d3c-776245f9a0b0 tempest-VolumeImageDependencyTests-1631845072 None] Created reservations ['23477f1d-28ed-4993-b592-a510ff694585', '55ed310b-50bf-4386-8bd2-7b32d1d7827e', '7c9fecfa-ee4f-4b1a-beca-4933455a62f0', '8593156a-228b-4536-a82a-4cd9bec47cc0'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:27:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-67dad269-baa4-415a-9d3c-776245f9a0b0 tempest-VolumeImageDependencyTests-1631845072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-67dad269-baa4-415a-9d3c-776245f9a0b0 tempest-VolumeImageDependencyTests-1631845072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-67dad269-baa4-415a-9d3c-776245f9a0b0 tempest-VolumeImageDependencyTests-1631845072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-67dad269-baa4-415a-9d3c-776245f9a0b0 tempest-VolumeImageDependencyTests-1631845072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-67dad269-baa4-415a-9d3c-776245f9a0b0 tempest-VolumeImageDependencyTests-1631845072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-67dad269-baa4-415a-9d3c-776245f9a0b0 tempest-VolumeImageDependencyTests-1631845072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:52 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:27:52 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:52 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e0be788d-fd50-4c2a-b44a-100c8e0392aa tempest-VolumeDependencyTests-998585106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.453s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:52 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-e0be788d-fd50-4c2a-b44a-100c8e0392aa tempest-VolumeDependencyTests-998585106 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:52 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-e0be788d-fd50-4c2a-b44a-100c8e0392aa tempest-VolumeDependencyTests-998585106 None] Deleted volume successfully. Sep 23 15:27:52 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e0be788d-fd50-4c2a-b44a-100c8e0392aa tempest-VolumeDependencyTests-998585106 None] Lock "cinder-a5a043df-b425-4585-9b83-f74badf63117-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:52 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-67dad269-baa4-415a-9d3c-776245f9a0b0 tempest-VolumeImageDependencyTests-1631845072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.406s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:53 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-67dad269-baa4-415a-9d3c-776245f9a0b0 tempest-VolumeImageDependencyTests-1631845072 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:27:53 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-67dad269-baa4-415a-9d3c-776245f9a0b0 tempest-VolumeImageDependencyTests-1631845072 None] Deleted volume successfully. Sep 23 15:27:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-67dad269-baa4-415a-9d3c-776245f9a0b0 tempest-VolumeImageDependencyTests-1631845072 None] Lock "cinder-08797de3-f6bf-4b84-915e-d47109ba3973-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:27:57 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Flow 'volume_create_manager' (2143c48d-8b0b-4c6f-8dc9-6c15b136c0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a366d03-40cd-4e96-85cb-43119def66b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a366d03-40cd-4e96-85cb-43119def66b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2936ab92-0754-4eaf-90ae-2aac4d3ff6f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7105d9c3d34c0ca2b0dde36cd77e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:57Z,use_quota=True,user_id='5bbdeedcd15c44dbb2314aaba8bdf099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11cfe9b9-6813-41a8-9027-b5f69861c6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11cfe9b9-6813-41a8-9027-b5f69861c6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d1a989-a0d6-43a6-baeb-41f5ff2013f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d1a989-a0d6-43a6-baeb-41f5ff2013f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2936ab92-0754-4eaf-90ae-2aac4d3ff6f6', 'volume_name': 'volume-2936ab92-0754-4eaf-90ae-2aac4d3ff6f6', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4454e7-69b3-454b-b9ef-a6d46f58c55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4454e7-69b3-454b-b9ef-a6d46f58c55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3079395-c477-4549-bf02-94895fb3b811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:57 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Volume 2936ab92-0754-4eaf-90ae-2aac4d3ff6f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2936ab92-0754-4eaf-90ae-2aac4d3ff6f6', 'volume_size': 1} Sep 23 15:27:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2936ab92-0754-4eaf-90ae-2aac4d3ff6f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7105d9c3d34c0ca2b0dde36cd77e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:27:57Z,use_quota=True,user_id='5bbdeedcd15c44dbb2314aaba8bdf099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Creating volume 2936ab92-0754-4eaf-90ae-2aac4d3ff6f6 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:57 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2936ab92-0754-4eaf-90ae-2aac4d3ff6f6 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:57 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2936ab92-0754-4eaf-90ae-2aac4d3ff6f6 1073741824 Sep 23 15:27:57 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:58 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2936ab92-0754-4eaf-90ae-2aac4d3ff6f6 1073741824" returned: 0 in 0.723s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2936ab92-0754-4eaf-90ae-2aac4d3ff6f6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:58 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2936ab92-0754-4eaf-90ae-2aac4d3ff6f6 Sep 23 15:27:58 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:27:58 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Sep 23 15:27:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2936ab92-0754-4eaf-90ae-2aac4d3ff6f6" returned: 0 in 0.404s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:27:58 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:27:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:58 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3079395-c477-4549-bf02-94895fb3b811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2936ab92-0754-4eaf-90ae-2aac4d3ff6f6', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:58 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65035bc0-2198-4b7f-a03c-1e3fb60ec1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:58 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Volume volume-2936ab92-0754-4eaf-90ae-2aac4d3ff6f6 (2936ab92-0754-4eaf-90ae-2aac4d3ff6f6): created successfully Sep 23 15:27:58 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65035bc0-2198-4b7f-a03c-1e3fb60ec1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:58 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Flow 'volume_create_manager' (2143c48d-8b0b-4c6f-8dc9-6c15b136c0af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:58 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7f54ab90-4a52-4f16-bebe-a3fd574ee206 tempest-CinderUnicodeTest-2042541880 None] Created volume successfully. Sep 23 15:27:59 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:27:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Flow 'volume_create_manager' (686c59b3-ccc2-44a2-8b88-c570f00931e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:27:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc8b0c5-0c5e-48c2-a3e7-1da3ab6ae90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc8b0c5-0c5e-48c2-a3e7-1da3ab6ae90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-605911506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef36ee87-dc2d-45b9-83d0-e26294c9ed8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66989f39c71404c9b228b7946437c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:00Z,use_quota=True,user_id='1a89078dd833490e8539b9c452c2a583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4873b5c-a837-419e-81e8-b6ee6ed48cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4873b5c-a837-419e-81e8-b6ee6ed48cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e6a0c93-e7c7-4d51-b5cb-b74a560ba868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e6a0c93-e7c7-4d51-b5cb-b74a560ba868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef36ee87-dc2d-45b9-83d0-e26294c9ed8f', 'volume_name': 'volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a49aeb4-0c04-47f7-994f-9de611e203a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a49aeb4-0c04-47f7-994f-9de611e203a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:27:59 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c28631-6381-417b-86be-40f3cb4f26ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:27:59 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Volume ef36ee87-dc2d-45b9-83d0-e26294c9ed8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f', 'volume_size': 1} Sep 23 15:27:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-605911506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef36ee87-dc2d-45b9-83d0-e26294c9ed8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66989f39c71404c9b228b7946437c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:00Z,use_quota=True,user_id='1a89078dd833490e8539b9c452c2a583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:27:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Creating volume ef36ee87-dc2d-45b9-83d0-e26294c9ed8f {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:27:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:27:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:27:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:27:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:27:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:27:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:27:59 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:27:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:27:59 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f 1073741824 Sep 23 15:27:59 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Flow 'volume_create_manager' (01dc517d-b89f-497b-a255-621bf0896b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d9ea89-9822-462b-98c8-f61b4b11650e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d9ea89-9822-462b-98c8-f61b4b11650e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1836097652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711da43e-ba85-44f0-b78c-19df219432b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7105d9c3d34c0ca2b0dde36cd77e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:00Z,use_quota=True,user_id='5bbdeedcd15c44dbb2314aaba8bdf099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00efe031-b717-4e20-a3c8-7caab921394e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00efe031-b717-4e20-a3c8-7caab921394e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af4d420-8b37-4bc0-a33f-1e6c92600735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af4d420-8b37-4bc0-a33f-1e6c92600735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '711da43e-ba85-44f0-b78c-19df219432b1', 'volume_name': 'volume-711da43e-ba85-44f0-b78c-19df219432b1', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85443247-08ca-4f1f-b84d-08bf19b37f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85443247-08ca-4f1f-b84d-08bf19b37f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b18bc1-e580-416f-b5ea-af3249e9dd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:00 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Volume 711da43e-ba85-44f0-b78c-19df219432b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-711da43e-ba85-44f0-b78c-19df219432b1', 'volume_size': 1} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:00 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f 1073741824" returned: 0 in 0.612s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:00 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f Sep 23 15:28:00 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:00 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f" returned: 0 in 0.295s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.468s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1836097652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711da43e-ba85-44f0-b78c-19df219432b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7105d9c3d34c0ca2b0dde36cd77e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:00Z,use_quota=True,user_id='5bbdeedcd15c44dbb2314aaba8bdf099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Creating volume 711da43e-ba85-44f0-b78c-19df219432b1 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:28:00 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:00 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1 1073741824 Sep 23 15:28:00 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c28631-6381-417b-86be-40f3cb4f26ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b2716d9-2823-4ee3-b94a-b3016cd68104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:00 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Volume volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f (ef36ee87-dc2d-45b9-83d0-e26294c9ed8f): created successfully Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b2716d9-2823-4ee3-b94a-b3016cd68104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Flow 'volume_create_manager' (686c59b3-ccc2-44a2-8b88-c570f00931e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:00 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-4c608815-0975-49be-b5d8-556944f6ac78 tempest-ProjectMemberTests-607392192 None] Created volume successfully. Sep 23 15:28:00 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:UPDATE=281,cinder:SELECT=208,cinder:INSERT=65,cinder:DELETE=21 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:28:01 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1 1073741824" returned: 0 in 0.556s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:01 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=187,cinder:UPDATE=272,cinder:DELETE=29,cinder:INSERT=81 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:28:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:01 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1 Sep 23 15:28:01 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:01 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1" returned: 0 in 0.547s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:28:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b18bc1-e580-416f-b5ea-af3249e9dd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-711da43e-ba85-44f0-b78c-19df219432b1', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:01 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (741e360c-efc0-4046-8946-63bf6e7a74da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:01 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Volume volume-711da43e-ba85-44f0-b78c-19df219432b1 (711da43e-ba85-44f0-b78c-19df219432b1): created successfully Sep 23 15:28:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (741e360c-efc0-4046-8946-63bf6e7a74da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Flow 'volume_create_manager' (01dc517d-b89f-497b-a255-621bf0896b14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:02 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-d8f585d9-b504-4586-9e1d-d3211d9110f6 tempest-CinderUnicodeTest-2042541880 None] Created volume successfully. Sep 23 15:28:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f3a9ad09-8669-4c40-a423-a008f0e48807 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f3a9ad09-8669-4c40-a423-a008f0e48807 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f3a9ad09-8669-4c40-a423-a008f0e48807 tempest-ProjectMemberTests-607392192 None] Creating offline snapshot a232059c-fb8d-4668-b5d7-1ac33a615dde of volume ef36ee87-dc2d-45b9-83d0-e26294c9ed8f {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:28:02 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d8b98b-e21d-4142-bdcd-acd913c478cb]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f3a9ad09-8669-4c40-a423-a008f0e48807 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:02 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f Sep 23 15:28:02 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7e038e6a-f109-4d41-baf7-33ab3688ee00 tempest-CinderUnicodeTest-2042541880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:02 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f3a9ad09-8669-4c40-a423-a008f0e48807 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f" returned: 0 in 0.592s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f3a9ad09-8669-4c40-a423-a008f0e48807 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.a232059c-fb8d-4668-b5d7-1ac33a615dde 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:02 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.a232059c-fb8d-4668-b5d7-1ac33a615dde 1G Sep 23 15:28:02 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:03 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f3a9ad09-8669-4c40-a423-a008f0e48807 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.a232059c-fb8d-4668-b5d7-1ac33a615dde 1G" returned: 0 in 0.653s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f3a9ad09-8669-4c40-a423-a008f0e48807 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.a232059c-fb8d-4668-b5d7-1ac33a615dde {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:03 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.a232059c-fb8d-4668-b5d7-1ac33a615dde Sep 23 15:28:03 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:04 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f3a9ad09-8669-4c40-a423-a008f0e48807 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.a232059c-fb8d-4668-b5d7-1ac33a615dde" returned: 0 in 0.467s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:04 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-f3a9ad09-8669-4c40-a423-a008f0e48807 tempest-ProjectMemberTests-607392192 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.a232059c-fb8d-4668-b5d7-1ac33a615dde is being set with open permissions: ugo+rw Sep 23 15:28:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f3a9ad09-8669-4c40-a423-a008f0e48807 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.a232059c-fb8d-4668-b5d7-1ac33a615dde {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:04 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.a232059c-fb8d-4668-b5d7-1ac33a615dde Sep 23 15:28:04 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:04 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f3a9ad09-8669-4c40-a423-a008f0e48807 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.a232059c-fb8d-4668-b5d7-1ac33a615dde" returned: 0 in 0.377s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f3a9ad09-8669-4c40-a423-a008f0e48807 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:04 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.info Sep 23 15:28:04 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:04 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f3a9ad09-8669-4c40-a423-a008f0e48807 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.info" returned: 0 in 0.324s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:04 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-f3a9ad09-8669-4c40-a423-a008f0e48807 tempest-ProjectMemberTests-607392192 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.info is being set with open permissions: ugo+rw Sep 23 15:28:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f3a9ad09-8669-4c40-a423-a008f0e48807 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:04 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.info Sep 23 15:28:04 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:05 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f3a9ad09-8669-4c40-a423-a008f0e48807 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.info" returned: 0 in 0.324s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f3a9ad09-8669-4c40-a423-a008f0e48807 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.906s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7e038e6a-f109-4d41-baf7-33ab3688ee00 tempest-CinderUnicodeTest-2042541880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.383s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-7e038e6a-f109-4d41-baf7-33ab3688ee00 tempest-CinderUnicodeTest-2042541880 None] Creating offline snapshot b10473f2-6e55-408e-a92b-d58a2e850632 of volume 711da43e-ba85-44f0-b78c-19df219432b1 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:28:05 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f3a9ad09-8669-4c40-a423-a008f0e48807 tempest-ProjectMemberTests-607392192 None] Create snapshot completed successfully Sep 23 15:28:05 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[5232fba6-071d-4986-b53c-3a9c92619bf8]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7e038e6a-f109-4d41-baf7-33ab3688ee00 tempest-CinderUnicodeTest-2042541880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:05 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1 Sep 23 15:28:05 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:05 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-62eaa66e-707c-4005-99eb-19dcf7ce4947 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-a232059c-fb8d-4668-b5d7-1ac33a615dde-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:05 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-62eaa66e-707c-4005-99eb-19dcf7ce4947 tempest-ProjectMemberTests-607392192 None] Lock "cinder-a232059c-fb8d-4668-b5d7-1ac33a615dde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:05 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-62eaa66e-707c-4005-99eb-19dcf7ce4947 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:05 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-62eaa66e-707c-4005-99eb-19dcf7ce4947 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:05 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-62eaa66e-707c-4005-99eb-19dcf7ce4947 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-a232059c-fb8d-4668-b5d7-1ac33a615dde" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:05 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-62eaa66e-707c-4005-99eb-19dcf7ce4947 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-a232059c-fb8d-4668-b5d7-1ac33a615dde" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-62eaa66e-707c-4005-99eb-19dcf7ce4947 tempest-ProjectMemberTests-607392192 None] Deleting offline snapshot a232059c-fb8d-4668-b5d7-1ac33a615dde of volume ef36ee87-dc2d-45b9-83d0-e26294c9ed8f {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:28:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-62eaa66e-707c-4005-99eb-19dcf7ce4947 tempest-ProjectMemberTests-607392192 None] snapshot_file for this snap is: volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.a232059c-fb8d-4668-b5d7-1ac33a615dde {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:28:05 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[734462bd-b289-491c-b527-3793e81a58d8]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-62eaa66e-707c-4005-99eb-19dcf7ce4947 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.a232059c-fb8d-4668-b5d7-1ac33a615dde {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:05 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:05 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.a232059c-fb8d-4668-b5d7-1ac33a615dde Sep 23 15:28:05 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7e038e6a-f109-4d41-baf7-33ab3688ee00 tempest-CinderUnicodeTest-2042541880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1" returned: 0 in 0.612s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7e038e6a-f109-4d41-baf7-33ab3688ee00 tempest-CinderUnicodeTest-2042541880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.b10473f2-6e55-408e-a92b-d58a2e850632 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:05 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.b10473f2-6e55-408e-a92b-d58a2e850632 1G Sep 23 15:28:05 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:06 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-62eaa66e-707c-4005-99eb-19dcf7ce4947 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.a232059c-fb8d-4668-b5d7-1ac33a615dde" returned: 0 in 0.541s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-62eaa66e-707c-4005-99eb-19dcf7ce4947 tempest-ProjectMemberTests-607392192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:28:06 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19afeea-6239-4048-b0a6-fdf6cb330c96]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-62eaa66e-707c-4005-99eb-19dcf7ce4947 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:06 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f Sep 23 15:28:06 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:06 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7e038e6a-f109-4d41-baf7-33ab3688ee00 tempest-CinderUnicodeTest-2042541880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.b10473f2-6e55-408e-a92b-d58a2e850632 1G" returned: 0 in 0.681s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7e038e6a-f109-4d41-baf7-33ab3688ee00 tempest-CinderUnicodeTest-2042541880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-711da43e-ba85-44f0-b78c-19df219432b1 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.b10473f2-6e55-408e-a92b-d58a2e850632 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:06 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-711da43e-ba85-44f0-b78c-19df219432b1 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.b10473f2-6e55-408e-a92b-d58a2e850632 Sep 23 15:28:06 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:06 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-62eaa66e-707c-4005-99eb-19dcf7ce4947 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f" returned: 0 in 0.515s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-62eaa66e-707c-4005-99eb-19dcf7ce4947 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.a232059c-fb8d-4668-b5d7-1ac33a615dde {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:06 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.a232059c-fb8d-4668-b5d7-1ac33a615dde Sep 23 15:28:06 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:07 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7e038e6a-f109-4d41-baf7-33ab3688ee00 tempest-CinderUnicodeTest-2042541880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-711da43e-ba85-44f0-b78c-19df219432b1 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.b10473f2-6e55-408e-a92b-d58a2e850632" returned: 0 in 0.475s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:07 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-7e038e6a-f109-4d41-baf7-33ab3688ee00 tempest-CinderUnicodeTest-2042541880 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.b10473f2-6e55-408e-a92b-d58a2e850632 is being set with open permissions: ugo+rw Sep 23 15:28:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7e038e6a-f109-4d41-baf7-33ab3688ee00 tempest-CinderUnicodeTest-2042541880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.b10473f2-6e55-408e-a92b-d58a2e850632 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:07 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.b10473f2-6e55-408e-a92b-d58a2e850632 Sep 23 15:28:07 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:07 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7e038e6a-f109-4d41-baf7-33ab3688ee00 tempest-CinderUnicodeTest-2042541880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.b10473f2-6e55-408e-a92b-d58a2e850632" returned: 0 in 0.365s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:07 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-62eaa66e-707c-4005-99eb-19dcf7ce4947 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.a232059c-fb8d-4668-b5d7-1ac33a615dde" returned: 0 in 0.605s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-62eaa66e-707c-4005-99eb-19dcf7ce4947 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.a232059c-fb8d-4668-b5d7-1ac33a615dde {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7e038e6a-f109-4d41-baf7-33ab3688ee00 tempest-CinderUnicodeTest-2042541880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:07 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.a232059c-fb8d-4668-b5d7-1ac33a615dde Sep 23 15:28:07 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:07 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.info Sep 23 15:28:07 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:07 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-62eaa66e-707c-4005-99eb-19dcf7ce4947 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f.a232059c-fb8d-4668-b5d7-1ac33a615dde" returned: 0 in 0.384s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:07 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7e038e6a-f109-4d41-baf7-33ab3688ee00 tempest-CinderUnicodeTest-2042541880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.info" returned: 0 in 0.429s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:07 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-7e038e6a-f109-4d41-baf7-33ab3688ee00 tempest-CinderUnicodeTest-2042541880 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.info is being set with open permissions: ugo+rw Sep 23 15:28:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7e038e6a-f109-4d41-baf7-33ab3688ee00 tempest-CinderUnicodeTest-2042541880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:07 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-62eaa66e-707c-4005-99eb-19dcf7ce4947 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-a232059c-fb8d-4668-b5d7-1ac33a615dde" released by "_delete_snapshot" :: held 2.267s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:07 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-62eaa66e-707c-4005-99eb-19dcf7ce4947 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f" released by "delete_snapshot" :: held 2.315s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:07 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.info Sep 23 15:28:07 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:08 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-62eaa66e-707c-4005-99eb-19dcf7ce4947 tempest-ProjectMemberTests-607392192 None] Created reservations ['a221da69-454b-4a7c-9ce2-2ab691be1890', '490bce36-1902-4db1-9782-95af966666ec', '46b8e30e-6cc3-4454-8ebe-64e1aee4763b', '327a6479-5c67-46e0-bfa6-3fc72f4a2506'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:08 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-62eaa66e-707c-4005-99eb-19dcf7ce4947 tempest-ProjectMemberTests-607392192 None] Delete snapshot completed successfully. Sep 23 15:28:08 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-62eaa66e-707c-4005-99eb-19dcf7ce4947 tempest-ProjectMemberTests-607392192 None] Lock "cinder-a232059c-fb8d-4668-b5d7-1ac33a615dde-delete_snapshot" released by "delete_snapshot" :: held 2.629s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:08 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7e038e6a-f109-4d41-baf7-33ab3688ee00 tempest-CinderUnicodeTest-2042541880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.info" returned: 0 in 0.457s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7e038e6a-f109-4d41-baf7-33ab3688ee00 tempest-CinderUnicodeTest-2042541880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.204s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:08 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7e038e6a-f109-4d41-baf7-33ab3688ee00 tempest-CinderUnicodeTest-2042541880 None] Create snapshot completed successfully Sep 23 15:28:08 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9a386650-aee5-45c7-be1d-f3e7cd859709 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:08 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9a386650-aee5-45c7-be1d-f3e7cd859709 tempest-ProjectMemberTests-607392192 None] Lock "cinder-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:08 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9a386650-aee5-45c7-be1d-f3e7cd859709 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:08 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9a386650-aee5-45c7-be1d-f3e7cd859709 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f" acquired by "delete_volume" :: waited 0.028s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:08 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f8989c-9e94-4bad-8f65-d05eca8652f9]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9a386650-aee5-45c7-be1d-f3e7cd859709 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:09 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f Sep 23 15:28:09 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:09 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7f0b98e9-0871-47f5-937c-1e43aa681c8d tempest-CinderUnicodeTest-2042541880 None] Acquiring lock "cinder-b10473f2-6e55-408e-a92b-d58a2e850632-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:09 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7f0b98e9-0871-47f5-937c-1e43aa681c8d tempest-CinderUnicodeTest-2042541880 None] Lock "cinder-b10473f2-6e55-408e-a92b-d58a2e850632-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:09 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7f0b98e9-0871-47f5-937c-1e43aa681c8d tempest-CinderUnicodeTest-2042541880 None] Acquiring lock "cinder-quobyte-711da43e-ba85-44f0-b78c-19df219432b1" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:09 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7f0b98e9-0871-47f5-937c-1e43aa681c8d tempest-CinderUnicodeTest-2042541880 None] Lock "cinder-quobyte-711da43e-ba85-44f0-b78c-19df219432b1" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:09 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7f0b98e9-0871-47f5-937c-1e43aa681c8d tempest-CinderUnicodeTest-2042541880 None] Acquiring lock "cinder-quobyte-b10473f2-6e55-408e-a92b-d58a2e850632" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:09 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7f0b98e9-0871-47f5-937c-1e43aa681c8d tempest-CinderUnicodeTest-2042541880 None] Lock "cinder-quobyte-b10473f2-6e55-408e-a92b-d58a2e850632" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:09 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-7f0b98e9-0871-47f5-937c-1e43aa681c8d tempest-CinderUnicodeTest-2042541880 None] Deleting offline snapshot b10473f2-6e55-408e-a92b-d58a2e850632 of volume 711da43e-ba85-44f0-b78c-19df219432b1 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:28:09 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-7f0b98e9-0871-47f5-937c-1e43aa681c8d tempest-CinderUnicodeTest-2042541880 None] snapshot_file for this snap is: volume-711da43e-ba85-44f0-b78c-19df219432b1.b10473f2-6e55-408e-a92b-d58a2e850632 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:28:09 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac90d698-bee7-4606-b527-7ffe8cc267dc]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7f0b98e9-0871-47f5-937c-1e43aa681c8d tempest-CinderUnicodeTest-2042541880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.b10473f2-6e55-408e-a92b-d58a2e850632 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:09 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.b10473f2-6e55-408e-a92b-d58a2e850632 Sep 23 15:28:09 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:09 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9a386650-aee5-45c7-be1d-f3e7cd859709 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f" returned: 0 in 0.622s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9a386650-aee5-45c7-be1d-f3e7cd859709 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:09 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f Sep 23 15:28:09 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:09 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7f0b98e9-0871-47f5-937c-1e43aa681c8d tempest-CinderUnicodeTest-2042541880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.b10473f2-6e55-408e-a92b-d58a2e850632" returned: 0 in 0.542s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:09 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-7f0b98e9-0871-47f5-937c-1e43aa681c8d tempest-CinderUnicodeTest-2042541880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-711da43e-ba85-44f0-b78c-19df219432b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:28:09 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9a386650-aee5-45c7-be1d-f3e7cd859709 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f" returned: 0 in 0.338s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:09 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08a8b5b-2c1d-475e-9506-58a6db6f784e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7f0b98e9-0871-47f5-937c-1e43aa681c8d tempest-CinderUnicodeTest-2042541880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:09 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9a386650-aee5-45c7-be1d-f3e7cd859709 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f" released by "delete_volume" :: held 1.058s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-9a386650-aee5-45c7-be1d-f3e7cd859709 tempest-ProjectMemberTests-607392192 None] Created reservations ['20623284-2a62-4618-bd7c-70baf4fe953e', '7f7fc307-e897-466a-8fc0-a904d0a9d7f8', 'e07361aa-131d-48ed-a49c-e0b6fca0d4f5', '0fe70e20-121a-4f4c-8465-b0e8d3bf8d90'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:10 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1 Sep 23 15:28:10 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9a386650-aee5-45c7-be1d-f3e7cd859709 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9a386650-aee5-45c7-be1d-f3e7cd859709 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9a386650-aee5-45c7-be1d-f3e7cd859709 tempest-ProjectMemberTests-607392192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9a386650-aee5-45c7-be1d-f3e7cd859709 tempest-ProjectMemberTests-607392192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9a386650-aee5-45c7-be1d-f3e7cd859709 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9a386650-aee5-45c7-be1d-f3e7cd859709 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:10 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:28:10 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:10 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9a386650-aee5-45c7-be1d-f3e7cd859709 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.327s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-9a386650-aee5-45c7-be1d-f3e7cd859709 tempest-ProjectMemberTests-607392192 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:28:10 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-9a386650-aee5-45c7-be1d-f3e7cd859709 tempest-ProjectMemberTests-607392192 None] Deleted volume successfully. Sep 23 15:28:10 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9a386650-aee5-45c7-be1d-f3e7cd859709 tempest-ProjectMemberTests-607392192 None] Lock "cinder-ef36ee87-dc2d-45b9-83d0-e26294c9ed8f-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7f0b98e9-0871-47f5-937c-1e43aa681c8d tempest-CinderUnicodeTest-2042541880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1" returned: 0 in 0.636s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7f0b98e9-0871-47f5-937c-1e43aa681c8d tempest-CinderUnicodeTest-2042541880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.b10473f2-6e55-408e-a92b-d58a2e850632 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:10 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.b10473f2-6e55-408e-a92b-d58a2e850632 Sep 23 15:28:10 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Flow 'volume_create_manager' (c5f01f1a-5717-4520-abd7-4903784c7248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019f2870-31e8-4329-8ea9-3f4d4a23f2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019f2870-31e8-4329-8ea9-3f4d4a23f2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-575706649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340ec9cb-eab4-4202-adc7-e35a9aae9146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba39a5743fc84344815864df80c9e15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:11Z,use_quota=True,user_id='e9eb056dbecb4d33844dedb63f298390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091d818c-47a3-4d5e-a5db-49d089a1467b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091d818c-47a3-4d5e-a5db-49d089a1467b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4947fe2d-ded9-4046-b403-24bd48b44fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4947fe2d-ded9-4046-b403-24bd48b44fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '340ec9cb-eab4-4202-adc7-e35a9aae9146', 'volume_name': 'volume-340ec9cb-eab4-4202-adc7-e35a9aae9146', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37cc0321-b078-4c0a-b3b6-aa6b4ddad74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37cc0321-b078-4c0a-b3b6-aa6b4ddad74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4da13a-e284-46d6-a86b-65fb32305e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:10 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Volume 340ec9cb-eab4-4202-adc7-e35a9aae9146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-340ec9cb-eab4-4202-adc7-e35a9aae9146', 'volume_size': 1} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-575706649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340ec9cb-eab4-4202-adc7-e35a9aae9146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba39a5743fc84344815864df80c9e15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:11Z,use_quota=True,user_id='e9eb056dbecb4d33844dedb63f298390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Creating volume 340ec9cb-eab4-4202-adc7-e35a9aae9146 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:28:10 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:28:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-340ec9cb-eab4-4202-adc7-e35a9aae9146 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:10 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-340ec9cb-eab4-4202-adc7-e35a9aae9146 1073741824 Sep 23 15:28:10 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:11 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7f0b98e9-0871-47f5-937c-1e43aa681c8d tempest-CinderUnicodeTest-2042541880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.b10473f2-6e55-408e-a92b-d58a2e850632" returned: 0 in 0.447s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7f0b98e9-0871-47f5-937c-1e43aa681c8d tempest-CinderUnicodeTest-2042541880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.b10473f2-6e55-408e-a92b-d58a2e850632 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:11 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.b10473f2-6e55-408e-a92b-d58a2e850632 Sep 23 15:28:11 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:11 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7f0b98e9-0871-47f5-937c-1e43aa681c8d tempest-CinderUnicodeTest-2042541880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1.b10473f2-6e55-408e-a92b-d58a2e850632" returned: 0 in 0.302s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7f0b98e9-0871-47f5-937c-1e43aa681c8d tempest-CinderUnicodeTest-2042541880 None] Lock "cinder-quobyte-b10473f2-6e55-408e-a92b-d58a2e850632" released by "_delete_snapshot" :: held 2.112s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7f0b98e9-0871-47f5-937c-1e43aa681c8d tempest-CinderUnicodeTest-2042541880 None] Lock "cinder-quobyte-711da43e-ba85-44f0-b78c-19df219432b1" released by "delete_snapshot" :: held 2.151s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-7f0b98e9-0871-47f5-937c-1e43aa681c8d tempest-CinderUnicodeTest-2042541880 None] Created reservations ['3ddca1be-d62b-41bd-a20a-93b31b7b4e09', 'd6081fe9-151f-43b6-866e-f2d2c7e94531', 'a8f6737e-6b46-46bc-be85-7ed8e7efa5b2', '6b7b89f5-1ef5-4f06-8bfe-f6402a4ae171'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:11 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7f0b98e9-0871-47f5-937c-1e43aa681c8d tempest-CinderUnicodeTest-2042541880 None] Delete snapshot completed successfully. Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7f0b98e9-0871-47f5-937c-1e43aa681c8d tempest-CinderUnicodeTest-2042541880 None] Lock "cinder-b10473f2-6e55-408e-a92b-d58a2e850632-delete_snapshot" released by "delete_snapshot" :: held 2.361s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:11 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-340ec9cb-eab4-4202-adc7-e35a9aae9146 1073741824" returned: 0 in 0.675s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-340ec9cb-eab4-4202-adc7-e35a9aae9146 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:11 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-340ec9cb-eab4-4202-adc7-e35a9aae9146 Sep 23 15:28:11 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Flow 'volume_create_manager' (ad033fec-993c-48b7-a7cd-a137b5a35522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a739dfc3-6dbb-4146-b3da-7f6749041d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a739dfc3-6dbb-4146-b3da-7f6749041d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2092175623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc51b30c-89d8-407f-9243-8c4e1d0cb0ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66989f39c71404c9b228b7946437c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:12Z,use_quota=True,user_id='1a89078dd833490e8539b9c452c2a583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203bb89b-7758-490c-b0c1-149a38232aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203bb89b-7758-490c-b0c1-149a38232aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0546294-ced2-4acf-b8ff-53980290be0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0546294-ced2-4acf-b8ff-53980290be0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc51b30c-89d8-407f-9243-8c4e1d0cb0ff', 'volume_name': 'volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653c3abe-6dcf-4805-a195-6b1e52e33033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653c3abe-6dcf-4805-a195-6b1e52e33033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8789a37d-8796-42ab-98f5-5f6a6720386e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:11 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Volume fc51b30c-89d8-407f-9243-8c4e1d0cb0ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff', 'volume_size': 1} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:11 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-340ec9cb-eab4-4202-adc7-e35a9aae9146" returned: 0 in 0.277s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.119s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2092175623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc51b30c-89d8-407f-9243-8c4e1d0cb0ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66989f39c71404c9b228b7946437c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:12Z,use_quota=True,user_id='1a89078dd833490e8539b9c452c2a583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Creating volume fc51b30c-89d8-407f-9243-8c4e1d0cb0ff {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:28:11 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4da13a-e284-46d6-a86b-65fb32305e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-340ec9cb-eab4-4202-adc7-e35a9aae9146', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae5cfaaf-5cf6-4ff1-93b6-47fcd3c24f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:11 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff 1073741824 Sep 23 15:28:11 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:11 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Volume volume-340ec9cb-eab4-4202-adc7-e35a9aae9146 (340ec9cb-eab4-4202-adc7-e35a9aae9146): created successfully Sep 23 15:28:11 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae5cfaaf-5cf6-4ff1-93b6-47fcd3c24f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Flow 'volume_create_manager' (c5f01f1a-5717-4520-abd7-4903784c7248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:12 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-772f65c5-e341-48c0-9f43-1bd833a895aa tempest-ProjectReaderTests-361531862 None] Created volume successfully. Sep 23 15:28:12 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b9a80f35-da62-4fc6-a933-d9efb61579c0 tempest-CinderUnicodeTest-2042541880 None] Acquiring lock "cinder-711da43e-ba85-44f0-b78c-19df219432b1-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff 1073741824" returned: 0 in 0.516s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b9a80f35-da62-4fc6-a933-d9efb61579c0 tempest-CinderUnicodeTest-2042541880 None] Lock "cinder-711da43e-ba85-44f0-b78c-19df219432b1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b9a80f35-da62-4fc6-a933-d9efb61579c0 tempest-CinderUnicodeTest-2042541880 None] Acquiring lock "cinder-quobyte-711da43e-ba85-44f0-b78c-19df219432b1" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:12 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff Sep 23 15:28:12 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b9a80f35-da62-4fc6-a933-d9efb61579c0 tempest-CinderUnicodeTest-2042541880 None] Lock "cinder-quobyte-711da43e-ba85-44f0-b78c-19df219432b1" acquired by "delete_volume" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:12 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d0e3be-572c-48bc-a5b0-42c16c5e7aaa]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9a80f35-da62-4fc6-a933-d9efb61579c0 tempest-CinderUnicodeTest-2042541880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:12 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1 Sep 23 15:28:12 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:12 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff" returned: 0 in 0.291s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:12 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:28:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8789a37d-8796-42ab-98f5-5f6a6720386e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b8aab2c-36c5-4503-b591-16fd0e18dd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:12 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Volume volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff (fc51b30c-89d8-407f-9243-8c4e1d0cb0ff): created successfully Sep 23 15:28:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b8aab2c-36c5-4503-b591-16fd0e18dd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:12 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Flow 'volume_create_manager' (ad033fec-993c-48b7-a7cd-a137b5a35522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:12 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-3d614f0c-49f7-4aa6-ab2a-d2e8d0621cd2 tempest-ProjectMemberTests-607392192 None] Created volume successfully. Sep 23 15:28:13 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9a80f35-da62-4fc6-a933-d9efb61579c0 tempest-CinderUnicodeTest-2042541880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1" returned: 0 in 0.473s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9a80f35-da62-4fc6-a933-d9efb61579c0 tempest-CinderUnicodeTest-2042541880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6c888ef4-e01a-494a-a096-6885b1e2d015 tempest-ProjectReaderTests-361531862 None] Acquiring lock "cinder-340ec9cb-eab4-4202-adc7-e35a9aae9146-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:13 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1 Sep 23 15:28:13 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6c888ef4-e01a-494a-a096-6885b1e2d015 tempest-ProjectReaderTests-361531862 None] Lock "cinder-340ec9cb-eab4-4202-adc7-e35a9aae9146-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6c888ef4-e01a-494a-a096-6885b1e2d015 tempest-ProjectReaderTests-361531862 None] Acquiring lock "cinder-quobyte-340ec9cb-eab4-4202-adc7-e35a9aae9146" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6c888ef4-e01a-494a-a096-6885b1e2d015 tempest-ProjectReaderTests-361531862 None] Lock "cinder-quobyte-340ec9cb-eab4-4202-adc7-e35a9aae9146" acquired by "delete_volume" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:13 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bf3a6f-518e-4e85-b717-8e7351404d7e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6c888ef4-e01a-494a-a096-6885b1e2d015 tempest-ProjectReaderTests-361531862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-340ec9cb-eab4-4202-adc7-e35a9aae9146 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:13 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-340ec9cb-eab4-4202-adc7-e35a9aae9146 Sep 23 15:28:13 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:13 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9a80f35-da62-4fc6-a933-d9efb61579c0 tempest-CinderUnicodeTest-2042541880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-711da43e-ba85-44f0-b78c-19df219432b1" returned: 0 in 0.426s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b9a80f35-da62-4fc6-a933-d9efb61579c0 tempest-CinderUnicodeTest-2042541880 None] Lock "cinder-quobyte-711da43e-ba85-44f0-b78c-19df219432b1" released by "delete_volume" :: held 0.996s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:13 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-b9a80f35-da62-4fc6-a933-d9efb61579c0 tempest-CinderUnicodeTest-2042541880 None] Created reservations ['0c384f7f-385e-4c7c-9477-8e123bdeb469', '6d583420-35fa-4bd3-8f82-01c09c5efb0e', 'e6004a21-37f1-4388-bfa0-5b623e56ee4b', '89fd1b10-c8b4-440a-a3b7-de53f607b2e2'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b9a80f35-da62-4fc6-a933-d9efb61579c0 tempest-CinderUnicodeTest-2042541880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b9a80f35-da62-4fc6-a933-d9efb61579c0 tempest-CinderUnicodeTest-2042541880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b9a80f35-da62-4fc6-a933-d9efb61579c0 tempest-CinderUnicodeTest-2042541880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b9a80f35-da62-4fc6-a933-d9efb61579c0 tempest-CinderUnicodeTest-2042541880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b9a80f35-da62-4fc6-a933-d9efb61579c0 tempest-CinderUnicodeTest-2042541880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9a80f35-da62-4fc6-a933-d9efb61579c0 tempest-CinderUnicodeTest-2042541880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:13 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:28:13 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:13 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6c888ef4-e01a-494a-a096-6885b1e2d015 tempest-ProjectReaderTests-361531862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-340ec9cb-eab4-4202-adc7-e35a9aae9146" returned: 0 in 0.638s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6c888ef4-e01a-494a-a096-6885b1e2d015 tempest-ProjectReaderTests-361531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-340ec9cb-eab4-4202-adc7-e35a9aae9146 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:13 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-340ec9cb-eab4-4202-adc7-e35a9aae9146 Sep 23 15:28:13 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2a8a73b6-eedf-4253-bdab-e05689c08705 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2a8a73b6-eedf-4253-bdab-e05689c08705 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-2a8a73b6-eedf-4253-bdab-e05689c08705 tempest-ProjectMemberTests-607392192 None] Creating offline snapshot 3be84628-c303-4b85-bcb4-106aeaf29a73 of volume fc51b30c-89d8-407f-9243-8c4e1d0cb0ff {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[306c90b7-2d04-4b1f-978a-e7d40cd400b8]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2a8a73b6-eedf-4253-bdab-e05689c08705 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:14 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b9a80f35-da62-4fc6-a933-d9efb61579c0 tempest-CinderUnicodeTest-2042541880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.414s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-b9a80f35-da62-4fc6-a933-d9efb61579c0 tempest-CinderUnicodeTest-2042541880 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:28:14 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-b9a80f35-da62-4fc6-a933-d9efb61579c0 tempest-CinderUnicodeTest-2042541880 None] Deleted volume successfully. Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-b9a80f35-da62-4fc6-a933-d9efb61579c0 tempest-CinderUnicodeTest-2042541880 None] Lock "cinder-711da43e-ba85-44f0-b78c-19df219432b1-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:14 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff Sep 23 15:28:14 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:14 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6c888ef4-e01a-494a-a096-6885b1e2d015 tempest-ProjectReaderTests-361531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-340ec9cb-eab4-4202-adc7-e35a9aae9146" returned: 0 in 0.397s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6c888ef4-e01a-494a-a096-6885b1e2d015 tempest-ProjectReaderTests-361531862 None] Lock "cinder-quobyte-340ec9cb-eab4-4202-adc7-e35a9aae9146" released by "delete_volume" :: held 1.108s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-6c888ef4-e01a-494a-a096-6885b1e2d015 tempest-ProjectReaderTests-361531862 None] Created reservations ['21e6b875-2cda-477a-ad56-33426ac89f2b', 'ded50959-58aa-4427-8c67-750de0ff1322', 'c4c8c01b-329e-4456-8853-5f8494463028', '64938e69-7937-425d-89a0-7c1c90ac3711'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6c888ef4-e01a-494a-a096-6885b1e2d015 tempest-ProjectReaderTests-361531862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6c888ef4-e01a-494a-a096-6885b1e2d015 tempest-ProjectReaderTests-361531862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6c888ef4-e01a-494a-a096-6885b1e2d015 tempest-ProjectReaderTests-361531862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-6c888ef4-e01a-494a-a096-6885b1e2d015 tempest-ProjectReaderTests-361531862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6c888ef4-e01a-494a-a096-6885b1e2d015 tempest-ProjectReaderTests-361531862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6c888ef4-e01a-494a-a096-6885b1e2d015 tempest-ProjectReaderTests-361531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:14 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:28:14 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:14 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2a8a73b6-eedf-4253-bdab-e05689c08705 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff" returned: 0 in 0.585s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2a8a73b6-eedf-4253-bdab-e05689c08705 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.3be84628-c303-4b85-bcb4-106aeaf29a73 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:14 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.3be84628-c303-4b85-bcb4-106aeaf29a73 1G Sep 23 15:28:14 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7274919e-53b0-4560-b558-96bcf9271a2c tempest-CinderUnicodeTest-2042541880 None] Acquiring lock "cinder-2936ab92-0754-4eaf-90ae-2aac4d3ff6f6-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7274919e-53b0-4560-b558-96bcf9271a2c tempest-CinderUnicodeTest-2042541880 None] Lock "cinder-2936ab92-0754-4eaf-90ae-2aac4d3ff6f6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:14 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6c888ef4-e01a-494a-a096-6885b1e2d015 tempest-ProjectReaderTests-361531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.394s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7274919e-53b0-4560-b558-96bcf9271a2c tempest-CinderUnicodeTest-2042541880 None] Acquiring lock "cinder-quobyte-2936ab92-0754-4eaf-90ae-2aac4d3ff6f6" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-6c888ef4-e01a-494a-a096-6885b1e2d015 tempest-ProjectReaderTests-361531862 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:28:14 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-6c888ef4-e01a-494a-a096-6885b1e2d015 tempest-ProjectReaderTests-361531862 None] Deleted volume successfully. Sep 23 15:28:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7274919e-53b0-4560-b558-96bcf9271a2c tempest-CinderUnicodeTest-2042541880 None] Lock "cinder-quobyte-2936ab92-0754-4eaf-90ae-2aac4d3ff6f6" acquired by "delete_volume" :: waited 0.030s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-6c888ef4-e01a-494a-a096-6885b1e2d015 tempest-ProjectReaderTests-361531862 None] Lock "cinder-340ec9cb-eab4-4202-adc7-e35a9aae9146-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:15 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8d4f36-38c1-459e-8101-480ee31b1352]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7274919e-53b0-4560-b558-96bcf9271a2c tempest-CinderUnicodeTest-2042541880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2936ab92-0754-4eaf-90ae-2aac4d3ff6f6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:15 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2936ab92-0754-4eaf-90ae-2aac4d3ff6f6 Sep 23 15:28:15 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:15 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2a8a73b6-eedf-4253-bdab-e05689c08705 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.3be84628-c303-4b85-bcb4-106aeaf29a73 1G" returned: 0 in 0.661s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2a8a73b6-eedf-4253-bdab-e05689c08705 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.3be84628-c303-4b85-bcb4-106aeaf29a73 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:15 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.3be84628-c303-4b85-bcb4-106aeaf29a73 Sep 23 15:28:15 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:15 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7274919e-53b0-4560-b558-96bcf9271a2c tempest-CinderUnicodeTest-2042541880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2936ab92-0754-4eaf-90ae-2aac4d3ff6f6" returned: 0 in 0.497s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7274919e-53b0-4560-b558-96bcf9271a2c tempest-CinderUnicodeTest-2042541880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2936ab92-0754-4eaf-90ae-2aac4d3ff6f6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:15 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2936ab92-0754-4eaf-90ae-2aac4d3ff6f6 Sep 23 15:28:15 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:15 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2a8a73b6-eedf-4253-bdab-e05689c08705 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.3be84628-c303-4b85-bcb4-106aeaf29a73" returned: 0 in 0.512s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:15 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-2a8a73b6-eedf-4253-bdab-e05689c08705 tempest-ProjectMemberTests-607392192 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.3be84628-c303-4b85-bcb4-106aeaf29a73 is being set with open permissions: ugo+rw Sep 23 15:28:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2a8a73b6-eedf-4253-bdab-e05689c08705 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.3be84628-c303-4b85-bcb4-106aeaf29a73 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:15 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.3be84628-c303-4b85-bcb4-106aeaf29a73 Sep 23 15:28:15 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:15 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7274919e-53b0-4560-b558-96bcf9271a2c tempest-CinderUnicodeTest-2042541880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-2936ab92-0754-4eaf-90ae-2aac4d3ff6f6" returned: 0 in 0.392s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7274919e-53b0-4560-b558-96bcf9271a2c tempest-CinderUnicodeTest-2042541880 None] Lock "cinder-quobyte-2936ab92-0754-4eaf-90ae-2aac4d3ff6f6" released by "delete_volume" :: held 0.963s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Flow 'volume_create_manager' (6a026e5a-e0a5-44c8-8c3a-a822cb2867ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89bcf36b-9ff5-4828-8b10-2cff9bd0e682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89bcf36b-9ff5-4828-8b10-2cff9bd0e682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1262604881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e673e136-8bca-4f68-a4f7-6c9b78040950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba39a5743fc84344815864df80c9e15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:16Z,use_quota=True,user_id='e9eb056dbecb4d33844dedb63f298390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (975bd486-cdec-4c9f-9bcd-881252aac90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (975bd486-cdec-4c9f-9bcd-881252aac90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7622d2c4-1014-4c63-9e2b-84943a0f47ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7622d2c4-1014-4c63-9e2b-84943a0f47ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e673e136-8bca-4f68-a4f7-6c9b78040950', 'volume_name': 'volume-e673e136-8bca-4f68-a4f7-6c9b78040950', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7803f067-7782-4075-94b0-7db8af8a1594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7803f067-7782-4075-94b0-7db8af8a1594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6a31df-e1f3-4cb5-85ba-4671276cc608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:16 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Volume e673e136-8bca-4f68-a4f7-6c9b78040950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e673e136-8bca-4f68-a4f7-6c9b78040950', 'volume_size': 1} Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-7274919e-53b0-4560-b558-96bcf9271a2c tempest-CinderUnicodeTest-2042541880 None] Created reservations ['96926c59-4604-4a3e-8df2-78ba59678185', '98492cde-8c63-489b-a472-88f1e3d1b55f', '85e58275-7378-4eb6-9956-b358487e115b', 'd8275952-21e3-4f04-832f-016ee1ee8556'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:16 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2a8a73b6-eedf-4253-bdab-e05689c08705 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.3be84628-c303-4b85-bcb4-106aeaf29a73" returned: 0 in 0.425s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7274919e-53b0-4560-b558-96bcf9271a2c tempest-CinderUnicodeTest-2042541880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7274919e-53b0-4560-b558-96bcf9271a2c tempest-CinderUnicodeTest-2042541880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7274919e-53b0-4560-b558-96bcf9271a2c tempest-CinderUnicodeTest-2042541880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7274919e-53b0-4560-b558-96bcf9271a2c tempest-CinderUnicodeTest-2042541880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7274919e-53b0-4560-b558-96bcf9271a2c tempest-CinderUnicodeTest-2042541880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7274919e-53b0-4560-b558-96bcf9271a2c tempest-CinderUnicodeTest-2042541880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2a8a73b6-eedf-4253-bdab-e05689c08705 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:16 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.info Sep 23 15:28:16 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:28:16 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:16 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:16 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7274919e-53b0-4560-b558-96bcf9271a2c tempest-CinderUnicodeTest-2042541880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.355s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-7274919e-53b0-4560-b558-96bcf9271a2c tempest-CinderUnicodeTest-2042541880 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:28:16 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7274919e-53b0-4560-b558-96bcf9271a2c tempest-CinderUnicodeTest-2042541880 None] Deleted volume successfully. Sep 23 15:28:16 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2a8a73b6-eedf-4253-bdab-e05689c08705 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.info" returned: 0 in 0.364s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:16 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-2a8a73b6-eedf-4253-bdab-e05689c08705 tempest-ProjectMemberTests-607392192 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.info is being set with open permissions: ugo+rw Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2a8a73b6-eedf-4253-bdab-e05689c08705 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7274919e-53b0-4560-b558-96bcf9271a2c tempest-CinderUnicodeTest-2042541880 None] Lock "cinder-2936ab92-0754-4eaf-90ae-2aac4d3ff6f6-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:16 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.info Sep 23 15:28:16 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:16 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2a8a73b6-eedf-4253-bdab-e05689c08705 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.info" returned: 0 in 0.285s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2a8a73b6-eedf-4253-bdab-e05689c08705 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.978s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.858s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1262604881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e673e136-8bca-4f68-a4f7-6c9b78040950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba39a5743fc84344815864df80c9e15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:16Z,use_quota=True,user_id='e9eb056dbecb4d33844dedb63f298390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:28:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Creating volume e673e136-8bca-4f68-a4f7-6c9b78040950 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:28:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:28:17 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:28:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e673e136-8bca-4f68-a4f7-6c9b78040950 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:17 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e673e136-8bca-4f68-a4f7-6c9b78040950 1073741824 Sep 23 15:28:17 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:17 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-2a8a73b6-eedf-4253-bdab-e05689c08705 tempest-ProjectMemberTests-607392192 None] Create snapshot completed successfully Sep 23 15:28:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e404aa9f-5a91-4b52-8b81-661d49d2afc4 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-3be84628-c303-4b85-bcb4-106aeaf29a73-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e404aa9f-5a91-4b52-8b81-661d49d2afc4 tempest-ProjectMemberTests-607392192 None] Lock "cinder-3be84628-c303-4b85-bcb4-106aeaf29a73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e404aa9f-5a91-4b52-8b81-661d49d2afc4 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e404aa9f-5a91-4b52-8b81-661d49d2afc4 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e404aa9f-5a91-4b52-8b81-661d49d2afc4 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-3be84628-c303-4b85-bcb4-106aeaf29a73" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:17 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e404aa9f-5a91-4b52-8b81-661d49d2afc4 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-3be84628-c303-4b85-bcb4-106aeaf29a73" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-e404aa9f-5a91-4b52-8b81-661d49d2afc4 tempest-ProjectMemberTests-607392192 None] Deleting offline snapshot 3be84628-c303-4b85-bcb4-106aeaf29a73 of volume fc51b30c-89d8-407f-9243-8c4e1d0cb0ff {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:28:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-e404aa9f-5a91-4b52-8b81-661d49d2afc4 tempest-ProjectMemberTests-607392192 None] snapshot_file for this snap is: volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.3be84628-c303-4b85-bcb4-106aeaf29a73 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:28:17 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2680c2-2c75-456a-878c-7ce67e4a11e4]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e404aa9f-5a91-4b52-8b81-661d49d2afc4 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.3be84628-c303-4b85-bcb4-106aeaf29a73 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:17 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.3be84628-c303-4b85-bcb4-106aeaf29a73 Sep 23 15:28:17 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:17 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e673e136-8bca-4f68-a4f7-6c9b78040950 1073741824" returned: 0 in 0.894s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e673e136-8bca-4f68-a4f7-6c9b78040950 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:18 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e673e136-8bca-4f68-a4f7-6c9b78040950 Sep 23 15:28:18 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:18 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e404aa9f-5a91-4b52-8b81-661d49d2afc4 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.3be84628-c303-4b85-bcb4-106aeaf29a73" returned: 0 in 0.632s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-e404aa9f-5a91-4b52-8b81-661d49d2afc4 tempest-ProjectMemberTests-607392192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:28:18 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cde391-3220-4452-96ce-ab7eb1095133]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e404aa9f-5a91-4b52-8b81-661d49d2afc4 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:18 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff Sep 23 15:28:18 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:18 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e673e136-8bca-4f68-a4f7-6c9b78040950" returned: 0 in 0.385s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:28:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:18 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6a31df-e1f3-4cb5-85ba-4671276cc608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e673e136-8bca-4f68-a4f7-6c9b78040950', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:18 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c282ba08-235c-4e82-9eca-ea6b37a70778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:18 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Volume volume-e673e136-8bca-4f68-a4f7-6c9b78040950 (e673e136-8bca-4f68-a4f7-6c9b78040950): created successfully Sep 23 15:28:18 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c282ba08-235c-4e82-9eca-ea6b37a70778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:18 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Flow 'volume_create_manager' (6a026e5a-e0a5-44c8-8c3a-a822cb2867ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:18 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-b54c9b65-74a2-4454-8eb2-a0a5da2cad8b tempest-ProjectReaderTests-361531862 None] Created volume successfully. Sep 23 15:28:18 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e404aa9f-5a91-4b52-8b81-661d49d2afc4 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff" returned: 0 in 0.567s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e404aa9f-5a91-4b52-8b81-661d49d2afc4 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.3be84628-c303-4b85-bcb4-106aeaf29a73 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:18 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.3be84628-c303-4b85-bcb4-106aeaf29a73 Sep 23 15:28:18 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:19 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e404aa9f-5a91-4b52-8b81-661d49d2afc4 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.3be84628-c303-4b85-bcb4-106aeaf29a73" returned: 0 in 0.407s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e404aa9f-5a91-4b52-8b81-661d49d2afc4 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.3be84628-c303-4b85-bcb4-106aeaf29a73 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:19 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.3be84628-c303-4b85-bcb4-106aeaf29a73 Sep 23 15:28:19 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-deb62fcb-2046-4030-b27a-62c2165fc838 tempest-ProjectReaderTests-361531862 None] Acquiring lock "cinder-e673e136-8bca-4f68-a4f7-6c9b78040950-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-deb62fcb-2046-4030-b27a-62c2165fc838 tempest-ProjectReaderTests-361531862 None] Lock "cinder-e673e136-8bca-4f68-a4f7-6c9b78040950-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-deb62fcb-2046-4030-b27a-62c2165fc838 tempest-ProjectReaderTests-361531862 None] Acquiring lock "cinder-quobyte-e673e136-8bca-4f68-a4f7-6c9b78040950" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-deb62fcb-2046-4030-b27a-62c2165fc838 tempest-ProjectReaderTests-361531862 None] Lock "cinder-quobyte-e673e136-8bca-4f68-a4f7-6c9b78040950" acquired by "delete_volume" :: waited 0.031s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:19 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e404aa9f-5a91-4b52-8b81-661d49d2afc4 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff.3be84628-c303-4b85-bcb4-106aeaf29a73" returned: 0 in 0.413s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:19 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf1313d-c46d-434f-ab24-2aee08bf3b5c]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-deb62fcb-2046-4030-b27a-62c2165fc838 tempest-ProjectReaderTests-361531862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e673e136-8bca-4f68-a4f7-6c9b78040950 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e404aa9f-5a91-4b52-8b81-661d49d2afc4 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-3be84628-c303-4b85-bcb4-106aeaf29a73" released by "_delete_snapshot" :: held 2.251s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e404aa9f-5a91-4b52-8b81-661d49d2afc4 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff" released by "delete_snapshot" :: held 2.286s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:19 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-e404aa9f-5a91-4b52-8b81-661d49d2afc4 tempest-ProjectMemberTests-607392192 None] Created reservations ['297855de-03e0-42b3-b2b2-25edda4c8c8a', '2aaae4ca-ec90-44b2-9721-5833c936e7a9', 'af055acc-d43e-47ea-874e-61809bec7443', 'c8d5296b-e249-4ee6-88a5-751f55ba61a8'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:19 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e673e136-8bca-4f68-a4f7-6c9b78040950 Sep 23 15:28:19 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:19 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-e404aa9f-5a91-4b52-8b81-661d49d2afc4 tempest-ProjectMemberTests-607392192 None] Delete snapshot completed successfully. Sep 23 15:28:19 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-e404aa9f-5a91-4b52-8b81-661d49d2afc4 tempest-ProjectMemberTests-607392192 None] Lock "cinder-3be84628-c303-4b85-bcb4-106aeaf29a73-delete_snapshot" released by "delete_snapshot" :: held 2.504s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:19 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:28:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Flow 'volume_create_manager' (20649a4e-59a9-4ec2-b833-68aa6c381e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:19 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb042121-1637-4762-9ae5-b6a396aa02ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb042121-1637-4762-9ae5-b6a396aa02ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-860567089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da172bd6-ee94-41cf-9ca7-03b0a7a41b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47717fe405d44cc0999040ec9ab06e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:20Z,use_quota=True,user_id='ce0ba6f31fec4f5881d7331adf774242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5242e054-6947-4929-9f93-66ecbd70c639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5242e054-6947-4929-9f93-66ecbd70c639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ec08bf-06fe-47b6-bd66-82ea7998e95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ec08bf-06fe-47b6-bd66-82ea7998e95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da172bd6-ee94-41cf-9ca7-03b0a7a41b83', 'volume_name': 'volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9010b39-eb1b-4159-bea5-d19b0e8bc0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9010b39-eb1b-4159-bea5-d19b0e8bc0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed69ff2-b8e3-4236-ac2f-f4287bfb89fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:20 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Volume da172bd6-ee94-41cf-9ca7-03b0a7a41b83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83', 'volume_size': 1} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-860567089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da172bd6-ee94-41cf-9ca7-03b0a7a41b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47717fe405d44cc0999040ec9ab06e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:20Z,use_quota=True,user_id='ce0ba6f31fec4f5881d7331adf774242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Creating volume da172bd6-ee94-41cf-9ca7-03b0a7a41b83 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:28:20 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:20 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-deb62fcb-2046-4030-b27a-62c2165fc838 tempest-ProjectReaderTests-361531862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e673e136-8bca-4f68-a4f7-6c9b78040950" returned: 0 in 0.545s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-deb62fcb-2046-4030-b27a-62c2165fc838 tempest-ProjectReaderTests-361531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e673e136-8bca-4f68-a4f7-6c9b78040950 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:20 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 1073741824 Sep 23 15:28:20 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:20 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e673e136-8bca-4f68-a4f7-6c9b78040950 Sep 23 15:28:20 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:20 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-deb62fcb-2046-4030-b27a-62c2165fc838 tempest-ProjectReaderTests-361531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-e673e136-8bca-4f68-a4f7-6c9b78040950" returned: 0 in 0.307s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-deb62fcb-2046-4030-b27a-62c2165fc838 tempest-ProjectReaderTests-361531862 None] Lock "cinder-quobyte-e673e136-8bca-4f68-a4f7-6c9b78040950" released by "delete_volume" :: held 0.946s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-deb62fcb-2046-4030-b27a-62c2165fc838 tempest-ProjectReaderTests-361531862 None] Created reservations ['d15888a2-ef3a-4d1a-bc9a-306c4bfc0907', '0c061d03-e191-4ce6-b5a2-d7b04cf28504', 'd332c5f6-6681-449e-8991-ea4a82f39a7a', '79afa953-2721-439b-a9f6-a5a41000e1d9'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-deb62fcb-2046-4030-b27a-62c2165fc838 tempest-ProjectReaderTests-361531862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-deb62fcb-2046-4030-b27a-62c2165fc838 tempest-ProjectReaderTests-361531862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-deb62fcb-2046-4030-b27a-62c2165fc838 tempest-ProjectReaderTests-361531862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-deb62fcb-2046-4030-b27a-62c2165fc838 tempest-ProjectReaderTests-361531862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-deb62fcb-2046-4030-b27a-62c2165fc838 tempest-ProjectReaderTests-361531862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-deb62fcb-2046-4030-b27a-62c2165fc838 tempest-ProjectReaderTests-361531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:20 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 1073741824" returned: 0 in 0.578s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:20 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:28:20 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-807b850e-40b1-41b4-aee1-016dce2acf15 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:20 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 Sep 23 15:28:20 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-807b850e-40b1-41b4-aee1-016dce2acf15 tempest-ProjectMemberTests-607392192 None] Lock "cinder-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-807b850e-40b1-41b4-aee1-016dce2acf15 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-807b850e-40b1-41b4-aee1-016dce2acf15 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff" acquired by "delete_volume" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a07b153-eb22-4ea6-a86a-60a8d76a1275]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-807b850e-40b1-41b4-aee1-016dce2acf15 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:20 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-deb62fcb-2046-4030-b27a-62c2165fc838 tempest-ProjectReaderTests-361531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.354s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:20 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-deb62fcb-2046-4030-b27a-62c2165fc838 tempest-ProjectReaderTests-361531862 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:28:20 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-deb62fcb-2046-4030-b27a-62c2165fc838 tempest-ProjectReaderTests-361531862 None] Deleted volume successfully. Sep 23 15:28:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-deb62fcb-2046-4030-b27a-62c2165fc838 tempest-ProjectReaderTests-361531862 None] Lock "cinder-e673e136-8bca-4f68-a4f7-6c9b78040950-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:21 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff Sep 23 15:28:21 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:21 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83" returned: 0 in 0.393s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:28:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed69ff2-b8e3-4236-ac2f-f4287bfb89fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5d969f-484e-4740-b97d-17f5ff675e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:21 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Volume volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 (da172bd6-ee94-41cf-9ca7-03b0a7a41b83): created successfully Sep 23 15:28:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5d969f-484e-4740-b97d-17f5ff675e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:21 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Flow 'volume_create_manager' (20649a4e-59a9-4ec2-b833-68aa6c381e91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:21 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-274c0151-4405-454c-8792-fe7dd27ced6e tempest-SnapshotDependencyTests-1915015512 None] Created volume successfully. Sep 23 15:28:21 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-807b850e-40b1-41b4-aee1-016dce2acf15 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff" returned: 0 in 0.442s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-807b850e-40b1-41b4-aee1-016dce2acf15 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:21 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff Sep 23 15:28:21 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:21 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-807b850e-40b1-41b4-aee1-016dce2acf15 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff" returned: 0 in 0.283s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-807b850e-40b1-41b4-aee1-016dce2acf15 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff" released by "delete_volume" :: held 0.811s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:21 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-807b850e-40b1-41b4-aee1-016dce2acf15 tempest-ProjectMemberTests-607392192 None] Created reservations ['ba728cc0-76b2-4237-a449-a89a2a221f2a', '5e716964-cc62-4e4e-9804-a4a113ac336a', 'eb74015a-9c08-4e7f-8a5a-6551c3914bb8', 'b9ba25a3-714b-4009-9b61-b717a942ce49'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-807b850e-40b1-41b4-aee1-016dce2acf15 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-807b850e-40b1-41b4-aee1-016dce2acf15 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-807b850e-40b1-41b4-aee1-016dce2acf15 tempest-ProjectMemberTests-607392192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-807b850e-40b1-41b4-aee1-016dce2acf15 tempest-ProjectMemberTests-607392192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-807b850e-40b1-41b4-aee1-016dce2acf15 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-807b850e-40b1-41b4-aee1-016dce2acf15 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:21 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:28:21 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:22 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-807b850e-40b1-41b4-aee1-016dce2acf15 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.358s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-807b850e-40b1-41b4-aee1-016dce2acf15 tempest-ProjectMemberTests-607392192 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:28:22 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-807b850e-40b1-41b4-aee1-016dce2acf15 tempest-ProjectMemberTests-607392192 None] Deleted volume successfully. Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-807b850e-40b1-41b4-aee1-016dce2acf15 tempest-ProjectMemberTests-607392192 None] Lock "cinder-fc51b30c-89d8-407f-9243-8c4e1d0cb0ff-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Flow 'volume_create_manager' (73a3a820-1296-4447-a00c-5222d106f1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25fa8ac-31e0-477d-bf3b-fac1703c1011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25fa8ac-31e0-477d-bf3b-fac1703c1011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-555997819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c7a103-abb4-4dcf-a345-5f882a71a88b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba39a5743fc84344815864df80c9e15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:22Z,use_quota=True,user_id='e9eb056dbecb4d33844dedb63f298390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98005a67-96e1-4f42-b84e-32607cc2cd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98005a67-96e1-4f42-b84e-32607cc2cd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc13c847-4419-41ea-9104-b4085eb202d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc13c847-4419-41ea-9104-b4085eb202d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87c7a103-abb4-4dcf-a345-5f882a71a88b', 'volume_name': 'volume-87c7a103-abb4-4dcf-a345-5f882a71a88b', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4519a45e-ce4f-4bc7-b844-f541186b17cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4519a45e-ce4f-4bc7-b844-f541186b17cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a619a2d3-8d26-4df8-994a-6d10db998ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:22 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Volume 87c7a103-abb4-4dcf-a345-5f882a71a88b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87c7a103-abb4-4dcf-a345-5f882a71a88b', 'volume_size': 1} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-555997819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c7a103-abb4-4dcf-a345-5f882a71a88b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba39a5743fc84344815864df80c9e15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:22Z,use_quota=True,user_id='e9eb056dbecb4d33844dedb63f298390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Creating volume 87c7a103-abb4-4dcf-a345-5f882a71a88b {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:28:22 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87c7a103-abb4-4dcf-a345-5f882a71a88b 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:22 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87c7a103-abb4-4dcf-a345-5f882a71a88b 1073741824 Sep 23 15:28:22 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-105ad7eb-1244-404e-b7ca-f322a26d78bc tempest-SnapshotDependencyTests-1915015512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Flow 'volume_create_manager' (bf98b886-0759-42c0-a2de-e4dcbd1929bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (894ff95e-ca04-4403-9bb2-9bac991ef51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (894ff95e-ca04-4403-9bb2-9bac991ef51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1987683246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56d930c2-67b8-45b9-9492-bda91f1cd21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66989f39c71404c9b228b7946437c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:23Z,use_quota=True,user_id='1a89078dd833490e8539b9c452c2a583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65847655-3473-406a-adfd-56c23842a204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65847655-3473-406a-adfd-56c23842a204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da8b1485-81d5-45cd-af29-98f773d330ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da8b1485-81d5-45cd-af29-98f773d330ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56d930c2-67b8-45b9-9492-bda91f1cd21f', 'volume_name': 'volume-56d930c2-67b8-45b9-9492-bda91f1cd21f', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d31d369-4491-4ec6-8604-42cad6840285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d31d369-4491-4ec6-8604-42cad6840285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850388f0-8e86-4380-a0f3-238e206ad042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:22 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Volume 56d930c2-67b8-45b9-9492-bda91f1cd21f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56d930c2-67b8-45b9-9492-bda91f1cd21f', 'volume_size': 1} Sep 23 15:28:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:23 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87c7a103-abb4-4dcf-a345-5f882a71a88b 1073741824" returned: 0 in 0.605s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87c7a103-abb4-4dcf-a345-5f882a71a88b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:23 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87c7a103-abb4-4dcf-a345-5f882a71a88b Sep 23 15:28:23 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:23 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87c7a103-abb4-4dcf-a345-5f882a71a88b" returned: 0 in 0.299s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:23 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:28:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-105ad7eb-1244-404e-b7ca-f322a26d78bc tempest-SnapshotDependencyTests-1915015512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.651s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a619a2d3-8d26-4df8-994a-6d10db998ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87c7a103-abb4-4dcf-a345-5f882a71a88b', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ffd0e0d-fd91-4469-a4a5-6a4f1445dbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:23 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-105ad7eb-1244-404e-b7ca-f322a26d78bc tempest-SnapshotDependencyTests-1915015512 None] Creating offline snapshot 4f5476bc-c4aa-4460-ba46-b725be6cfa60 of volume da172bd6-ee94-41cf-9ca7-03b0a7a41b83 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:28:23 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Volume volume-87c7a103-abb4-4dcf-a345-5f882a71a88b (87c7a103-abb4-4dcf-a345-5f882a71a88b): created successfully Sep 23 15:28:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ffd0e0d-fd91-4469-a4a5-6a4f1445dbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Flow 'volume_create_manager' (73a3a820-1296-4447-a00c-5222d106f1ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:23 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f99225-76ca-414a-beb8-d8f5a1d9596f]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-105ad7eb-1244-404e-b7ca-f322a26d78bc tempest-SnapshotDependencyTests-1915015512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:23 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-fc2ceade-3cfe-4ebb-8007-f6157d3a1719 tempest-ProjectReaderTests-361531862 None] Created volume successfully. Sep 23 15:28:23 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 Sep 23 15:28:23 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:23 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-105ad7eb-1244-404e-b7ca-f322a26d78bc tempest-SnapshotDependencyTests-1915015512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83" returned: 0 in 0.416s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-105ad7eb-1244-404e-b7ca-f322a26d78bc tempest-SnapshotDependencyTests-1915015512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:23 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60 1G Sep 23 15:28:23 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:24 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-105ad7eb-1244-404e-b7ca-f322a26d78bc tempest-SnapshotDependencyTests-1915015512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60 1G" returned: 0 in 0.436s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-105ad7eb-1244-404e-b7ca-f322a26d78bc tempest-SnapshotDependencyTests-1915015512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:24 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60 Sep 23 15:28:24 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-264eaaa4-43ad-4445-8542-c8c5c8445111 tempest-ProjectReaderTests-361531862 None] Acquiring lock "cinder-87c7a103-abb4-4dcf-a345-5f882a71a88b-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-264eaaa4-43ad-4445-8542-c8c5c8445111 tempest-ProjectReaderTests-361531862 None] Lock "cinder-87c7a103-abb4-4dcf-a345-5f882a71a88b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-264eaaa4-43ad-4445-8542-c8c5c8445111 tempest-ProjectReaderTests-361531862 None] Acquiring lock "cinder-quobyte-87c7a103-abb4-4dcf-a345-5f882a71a88b" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-264eaaa4-43ad-4445-8542-c8c5c8445111 tempest-ProjectReaderTests-361531862 None] Lock "cinder-quobyte-87c7a103-abb4-4dcf-a345-5f882a71a88b" acquired by "delete_volume" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:24 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f825c1-be49-46ca-b25b-8a693e49bd60]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-264eaaa4-43ad-4445-8542-c8c5c8445111 tempest-ProjectReaderTests-361531862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87c7a103-abb4-4dcf-a345-5f882a71a88b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:24 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-105ad7eb-1244-404e-b7ca-f322a26d78bc tempest-SnapshotDependencyTests-1915015512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60" returned: 0 in 0.388s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:24 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-105ad7eb-1244-404e-b7ca-f322a26d78bc tempest-SnapshotDependencyTests-1915015512 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60 is being set with open permissions: ugo+rw Sep 23 15:28:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-105ad7eb-1244-404e-b7ca-f322a26d78bc tempest-SnapshotDependencyTests-1915015512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:24 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60 Sep 23 15:28:24 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:24 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87c7a103-abb4-4dcf-a345-5f882a71a88b Sep 23 15:28:24 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:24 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-105ad7eb-1244-404e-b7ca-f322a26d78bc tempest-SnapshotDependencyTests-1915015512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60" returned: 0 in 0.315s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-105ad7eb-1244-404e-b7ca-f322a26d78bc tempest-SnapshotDependencyTests-1915015512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:25 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.info Sep 23 15:28:25 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:25 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-264eaaa4-43ad-4445-8542-c8c5c8445111 tempest-ProjectReaderTests-361531862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87c7a103-abb4-4dcf-a345-5f882a71a88b" returned: 0 in 0.512s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-264eaaa4-43ad-4445-8542-c8c5c8445111 tempest-ProjectReaderTests-361531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87c7a103-abb4-4dcf-a345-5f882a71a88b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:25 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87c7a103-abb4-4dcf-a345-5f882a71a88b Sep 23 15:28:25 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:25 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-105ad7eb-1244-404e-b7ca-f322a26d78bc tempest-SnapshotDependencyTests-1915015512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.info" returned: 0 in 0.355s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:25 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-105ad7eb-1244-404e-b7ca-f322a26d78bc tempest-SnapshotDependencyTests-1915015512 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.info is being set with open permissions: ugo+rw Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-105ad7eb-1244-404e-b7ca-f322a26d78bc tempest-SnapshotDependencyTests-1915015512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:25 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.info Sep 23 15:28:25 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:25 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-264eaaa4-43ad-4445-8542-c8c5c8445111 tempest-ProjectReaderTests-361531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-87c7a103-abb4-4dcf-a345-5f882a71a88b" returned: 0 in 0.303s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-264eaaa4-43ad-4445-8542-c8c5c8445111 tempest-ProjectReaderTests-361531862 None] Lock "cinder-quobyte-87c7a103-abb4-4dcf-a345-5f882a71a88b" released by "delete_volume" :: held 0.870s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-264eaaa4-43ad-4445-8542-c8c5c8445111 tempest-ProjectReaderTests-361531862 None] Created reservations ['9e9279f7-e45f-44ac-bee7-2eb391ba4301', 'f62f4119-fcb2-435a-8a24-b42b75e1f620', '6b0d48b4-7ef1-403e-975d-5bddb1fae9e2', 'c8558038-3b52-470b-aa1c-778aa25ce7fe'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-264eaaa4-43ad-4445-8542-c8c5c8445111 tempest-ProjectReaderTests-361531862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-264eaaa4-43ad-4445-8542-c8c5c8445111 tempest-ProjectReaderTests-361531862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-264eaaa4-43ad-4445-8542-c8c5c8445111 tempest-ProjectReaderTests-361531862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-264eaaa4-43ad-4445-8542-c8c5c8445111 tempest-ProjectReaderTests-361531862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-264eaaa4-43ad-4445-8542-c8c5c8445111 tempest-ProjectReaderTests-361531862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-264eaaa4-43ad-4445-8542-c8c5c8445111 tempest-ProjectReaderTests-361531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:25 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:28:25 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:25 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-105ad7eb-1244-404e-b7ca-f322a26d78bc tempest-SnapshotDependencyTests-1915015512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.info" returned: 0 in 0.298s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-105ad7eb-1244-404e-b7ca-f322a26d78bc tempest-SnapshotDependencyTests-1915015512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.368s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.774s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1987683246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56d930c2-67b8-45b9-9492-bda91f1cd21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66989f39c71404c9b228b7946437c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:23Z,use_quota=True,user_id='1a89078dd833490e8539b9c452c2a583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Creating volume 56d930c2-67b8-45b9-9492-bda91f1cd21f {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:28:25 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:25 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f 1073741824 Sep 23 15:28:25 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:25 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-105ad7eb-1244-404e-b7ca-f322a26d78bc tempest-SnapshotDependencyTests-1915015512 None] Create snapshot completed successfully Sep 23 15:28:25 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-264eaaa4-43ad-4445-8542-c8c5c8445111 tempest-ProjectReaderTests-361531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.306s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:25 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-264eaaa4-43ad-4445-8542-c8c5c8445111 tempest-ProjectReaderTests-361531862 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:28:25 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-264eaaa4-43ad-4445-8542-c8c5c8445111 tempest-ProjectReaderTests-361531862 None] Deleted volume successfully. Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-264eaaa4-43ad-4445-8542-c8c5c8445111 tempest-ProjectReaderTests-361531862 None] Lock "cinder-87c7a103-abb4-4dcf-a345-5f882a71a88b-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:28:26 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Flow 'volume_create_manager' (2460c6d7-cd41-4993-ab31-5d26fe27d717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5819e07-0c59-4d7c-af91-bfe27fca6aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f 1073741824" returned: 0 in 0.599s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5819e07-0c59-4d7c-af91-bfe27fca6aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1634881892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1e22cb-c45e-4dc9-90c4-558da829533f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba39a5743fc84344815864df80c9e15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:26Z,use_quota=True,user_id='e9eb056dbecb4d33844dedb63f298390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea3a7f7-83c6-473b-8e7a-1e16ae0f9984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea3a7f7-83c6-473b-8e7a-1e16ae0f9984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1703910d-fc28-48f9-8cf7-ed30630f3081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1703910d-fc28-48f9-8cf7-ed30630f3081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de1e22cb-c45e-4dc9-90c4-558da829533f', 'volume_name': 'volume-de1e22cb-c45e-4dc9-90c4-558da829533f', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (723b5110-b79e-4710-a1ed-7e2a1c0a992a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (723b5110-b79e-4710-a1ed-7e2a1c0a992a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea3c41a-7f5e-498a-b000-89753f8d338b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:26 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Volume de1e22cb-c45e-4dc9-90c4-558da829533f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de1e22cb-c45e-4dc9-90c4-558da829533f', 'volume_size': 1} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:26 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f Sep 23 15:28:26 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f" returned: 0 in 0.306s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:28:26 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.342s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1634881892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1e22cb-c45e-4dc9-90c4-558da829533f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba39a5743fc84344815864df80c9e15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:26Z,use_quota=True,user_id='e9eb056dbecb4d33844dedb63f298390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Creating volume de1e22cb-c45e-4dc9-90c4-558da829533f {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:28:26 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-de1e22cb-c45e-4dc9-90c4-558da829533f 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:26 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-de1e22cb-c45e-4dc9-90c4-558da829533f 1073741824 Sep 23 15:28:26 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850388f0-8e86-4380-a0f3-238e206ad042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56d930c2-67b8-45b9-9492-bda91f1cd21f', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca7beaa9-0f24-48ab-bbcd-39d1d2b25efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:26 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Volume volume-56d930c2-67b8-45b9-9492-bda91f1cd21f (56d930c2-67b8-45b9-9492-bda91f1cd21f): created successfully Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca7beaa9-0f24-48ab-bbcd-39d1d2b25efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:26 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Flow 'volume_create_manager' (bf98b886-0759-42c0-a2de-e4dcbd1929bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:26 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-26abd2fe-93b3-4041-b55b-8b3212ebde54 tempest-ProjectMemberTests-607392192 None] Created volume successfully. Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-52032a7a-e302-4092-bd5d-81362f4b1d48 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:27 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-de1e22cb-c45e-4dc9-90c4-558da829533f 1073741824" returned: 0 in 0.625s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-de1e22cb-c45e-4dc9-90c4-558da829533f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:27 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-de1e22cb-c45e-4dc9-90c4-558da829533f Sep 23 15:28:27 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Flow 'volume_create_manager' (f1569c79-6a3b-42d5-a243-bc8852d4ae08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47889cd6-ab92-4551-bb74-54bec55329c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47889cd6-ab92-4551-bb74-54bec55329c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb68ce0-80cb-4836-b990-c3f0f53d6cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47717fe405d44cc0999040ec9ab06e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4f5476bc-c4aa-4460-ba46-b725be6cfa60,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:28Z,use_quota=True,user_id='ce0ba6f31fec4f5881d7331adf774242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43ecf20-1f00-4b24-b4d6-e58520516f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43ecf20-1f00-4b24-b4d6-e58520516f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:27 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c56059-e7b3-4b1b-8e6d-1c18e8c5fd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c56059-e7b3-4b1b-8e6d-1c18e8c5fd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eeb68ce0-80cb-4836-b990-c3f0f53d6cfa', 'volume_name': 'volume-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa', 'volume_size': 1, 'snapshot_id': '4f5476bc-c4aa-4460-ba46-b725be6cfa60'}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba55b5b-14bd-417d-a6c6-b933acfa0dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba55b5b-14bd-417d-a6c6-b933acfa0dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb4728d4-c21a-4bbf-b47b-e07076544131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:27 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Volume eeb68ce0-80cb-4836-b990-c3f0f53d6cfa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa', 'volume_size': 1, 'snapshot_id': '4f5476bc-c4aa-4460-ba46-b725be6cfa60'} Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-de1e22cb-c45e-4dc9-90c4-558da829533f" returned: 0 in 0.323s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-52032a7a-e302-4092-bd5d-81362f4b1d48 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.475s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea3c41a-7f5e-498a-b000-89753f8d338b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de1e22cb-c45e-4dc9-90c4-558da829533f', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8f9ba4-89e7-4471-a68a-853e4ec0a896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-52032a7a-e302-4092-bd5d-81362f4b1d48 tempest-ProjectMemberTests-607392192 None] Creating offline snapshot de67fbe2-cca8-430e-bf3c-1a4904848285 of volume 56d930c2-67b8-45b9-9492-bda91f1cd21f {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:28:27 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Volume volume-de1e22cb-c45e-4dc9-90c4-558da829533f (de1e22cb-c45e-4dc9-90c4-558da829533f): created successfully Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8f9ba4-89e7-4471-a68a-853e4ec0a896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Flow 'volume_create_manager' (2460c6d7-cd41-4993-ab31-5d26fe27d717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24e17aa-cdb9-4b80-b75e-a5b0f752540e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-52032a7a-e302-4092-bd5d-81362f4b1d48 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:27 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-c00addb1-4971-4590-9344-22fe7dc302be tempest-ProjectReaderTests-361531862 None] Created volume successfully. Sep 23 15:28:27 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f Sep 23 15:28:27 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:28 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-52032a7a-e302-4092-bd5d-81362f4b1d48 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f" returned: 0 in 0.414s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-52032a7a-e302-4092-bd5d-81362f4b1d48 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.de67fbe2-cca8-430e-bf3c-1a4904848285 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:28 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.de67fbe2-cca8-430e-bf3c-1a4904848285 1G Sep 23 15:28:28 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cdf92170-f025-407f-abeb-6c0591dc1a72 tempest-ProjectReaderTests-361531862 None] Acquiring lock "cinder-de1e22cb-c45e-4dc9-90c4-558da829533f-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:28 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:28:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Flow 'volume_create_manager' (e4de7816-8d83-4d8d-96f3-c98547727dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a5ff7a9-f57f-458b-b61f-e15869d7e190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cdf92170-f025-407f-abeb-6c0591dc1a72 tempest-ProjectReaderTests-361531862 None] Lock "cinder-de1e22cb-c45e-4dc9-90c4-558da829533f-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a5ff7a9-f57f-458b-b61f-e15869d7e190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551147058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd8d790-231f-42db-967c-cda3100e98c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fde52c53113485f85c9f1f77a36927e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:28Z,use_quota=True,user_id='90a09068610840cfbdf2be72dd01f471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a947c8-cee0-4135-8fd2-7f4a2b2fa495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a947c8-cee0-4135-8fd2-7f4a2b2fa495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fdb4a63-6ec4-458b-99ff-d420c71cf730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fdb4a63-6ec4-458b-99ff-d420c71cf730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abd8d790-231f-42db-967c-cda3100e98c2', 'volume_name': 'volume-abd8d790-231f-42db-967c-cda3100e98c2', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f61a4b4-02e1-439a-8058-5437c6cfb633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f61a4b4-02e1-439a-8058-5437c6cfb633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:28 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae30173c-1115-427c-a27a-ae79c0522681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:28 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Volume abd8d790-231f-42db-967c-cda3100e98c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abd8d790-231f-42db-967c-cda3100e98c2', 'volume_size': 1} Sep 23 15:28:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cdf92170-f025-407f-abeb-6c0591dc1a72 tempest-ProjectReaderTests-361531862 None] Acquiring lock "cinder-quobyte-de1e22cb-c45e-4dc9-90c4-558da829533f" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cdf92170-f025-407f-abeb-6c0591dc1a72 tempest-ProjectReaderTests-361531862 None] Lock "cinder-quobyte-de1e22cb-c45e-4dc9-90c4-558da829533f" acquired by "delete_volume" :: waited 0.016s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:28 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b8cf96-1ff8-4ade-828b-5611b5766afb]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cdf92170-f025-407f-abeb-6c0591dc1a72 tempest-ProjectReaderTests-361531862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-de1e22cb-c45e-4dc9-90c4-558da829533f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:28 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-52032a7a-e302-4092-bd5d-81362f4b1d48 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.de67fbe2-cca8-430e-bf3c-1a4904848285 1G" returned: 0 in 0.496s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-52032a7a-e302-4092-bd5d-81362f4b1d48 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56d930c2-67b8-45b9-9492-bda91f1cd21f -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.de67fbe2-cca8-430e-bf3c-1a4904848285 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:28 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-de1e22cb-c45e-4dc9-90c4-558da829533f Sep 23 15:28:28 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:28 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56d930c2-67b8-45b9-9492-bda91f1cd21f -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.de67fbe2-cca8-430e-bf3c-1a4904848285 Sep 23 15:28:28 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:29 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cdf92170-f025-407f-abeb-6c0591dc1a72 tempest-ProjectReaderTests-361531862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-de1e22cb-c45e-4dc9-90c4-558da829533f" returned: 0 in 0.379s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cdf92170-f025-407f-abeb-6c0591dc1a72 tempest-ProjectReaderTests-361531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-de1e22cb-c45e-4dc9-90c4-558da829533f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:29 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-de1e22cb-c45e-4dc9-90c4-558da829533f Sep 23 15:28:29 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:29 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-52032a7a-e302-4092-bd5d-81362f4b1d48 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56d930c2-67b8-45b9-9492-bda91f1cd21f -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.de67fbe2-cca8-430e-bf3c-1a4904848285" returned: 0 in 0.318s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:29 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-52032a7a-e302-4092-bd5d-81362f4b1d48 tempest-ProjectMemberTests-607392192 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.de67fbe2-cca8-430e-bf3c-1a4904848285 is being set with open permissions: ugo+rw Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-52032a7a-e302-4092-bd5d-81362f4b1d48 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.de67fbe2-cca8-430e-bf3c-1a4904848285 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:29 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.de67fbe2-cca8-430e-bf3c-1a4904848285 Sep 23 15:28:29 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:29 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cdf92170-f025-407f-abeb-6c0591dc1a72 tempest-ProjectReaderTests-361531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-de1e22cb-c45e-4dc9-90c4-558da829533f" returned: 0 in 0.276s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:29 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cdf92170-f025-407f-abeb-6c0591dc1a72 tempest-ProjectReaderTests-361531862 None] Lock "cinder-quobyte-de1e22cb-c45e-4dc9-90c4-558da829533f" released by "delete_volume" :: held 0.701s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-52032a7a-e302-4092-bd5d-81362f4b1d48 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.de67fbe2-cca8-430e-bf3c-1a4904848285" returned: 0 in 0.260s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-52032a7a-e302-4092-bd5d-81362f4b1d48 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:29 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.info Sep 23 15:28:29 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-cdf92170-f025-407f-abeb-6c0591dc1a72 tempest-ProjectReaderTests-361531862 None] Created reservations ['d3486744-c8ed-4595-b360-bbc708c76bc2', '082f9128-d2f5-47bb-802f-338d1aedcab4', 'e2f2fff9-0b40-4e98-9f50-35b4c40ed5a6', '7f29da4d-9695-401a-8f63-c8ec843f3ec8'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cdf92170-f025-407f-abeb-6c0591dc1a72 tempest-ProjectReaderTests-361531862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cdf92170-f025-407f-abeb-6c0591dc1a72 tempest-ProjectReaderTests-361531862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cdf92170-f025-407f-abeb-6c0591dc1a72 tempest-ProjectReaderTests-361531862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-cdf92170-f025-407f-abeb-6c0591dc1a72 tempest-ProjectReaderTests-361531862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-cdf92170-f025-407f-abeb-6c0591dc1a72 tempest-ProjectReaderTests-361531862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cdf92170-f025-407f-abeb-6c0591dc1a72 tempest-ProjectReaderTests-361531862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:29 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:28:29 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:29 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-52032a7a-e302-4092-bd5d-81362f4b1d48 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.info" returned: 0 in 0.283s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:29 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-52032a7a-e302-4092-bd5d-81362f4b1d48 tempest-ProjectMemberTests-607392192 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.info is being set with open permissions: ugo+rw Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-52032a7a-e302-4092-bd5d-81362f4b1d48 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:29 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.info Sep 23 15:28:29 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:29 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-cdf92170-f025-407f-abeb-6c0591dc1a72 tempest-ProjectReaderTests-361531862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.275s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-cdf92170-f025-407f-abeb-6c0591dc1a72 tempest-ProjectReaderTests-361531862 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:28:29 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-cdf92170-f025-407f-abeb-6c0591dc1a72 tempest-ProjectReaderTests-361531862 None] Deleted volume successfully. Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-cdf92170-f025-407f-abeb-6c0591dc1a72 tempest-ProjectReaderTests-361531862 None] Lock "cinder-de1e22cb-c45e-4dc9-90c4-558da829533f-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:29 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-52032a7a-e302-4092-bd5d-81362f4b1d48 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.info" returned: 0 in 0.279s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-52032a7a-e302-4092-bd5d-81362f4b1d48 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.173s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.167s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Acquiring lock "cinder-quobyte-4f5476bc-c4aa-4460-ba46-b725be6cfa60-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa" by "_create_volume_from_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Lock "cinder-quobyte-4f5476bc-c4aa-4460-ba46-b725be6cfa60-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Creating volume eeb68ce0-80cb-4836-b990-c3f0f53d6cfa from snapshot 4f5476bc-c4aa-4460-ba46-b725be6cfa60 {{(pid=86064) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:28:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Acquiring lock "cinder-quobyte-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa" by "_copy_volume_from_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Lock "cinder-quobyte-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] snapshot: 4f5476bc-c4aa-4460-ba46-b725be6cfa60, volume: eeb68ce0-80cb-4836-b990-c3f0f53d6cfa, {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 15:28:30 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-52032a7a-e302-4092-bd5d-81362f4b1d48 tempest-ProjectMemberTests-607392192 None] Create snapshot completed successfully Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3513d13d-75eb-4add-be6d-756ec57f56db]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:30 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60 Sep 23 15:28:30 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f52cf22e-4204-4b59-b9c6-964f5788d093 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-de67fbe2-cca8-430e-bf3c-1a4904848285-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f52cf22e-4204-4b59-b9c6-964f5788d093 tempest-ProjectMemberTests-607392192 None] Lock "cinder-de67fbe2-cca8-430e-bf3c-1a4904848285-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f52cf22e-4204-4b59-b9c6-964f5788d093 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-56d930c2-67b8-45b9-9492-bda91f1cd21f" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f52cf22e-4204-4b59-b9c6-964f5788d093 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-56d930c2-67b8-45b9-9492-bda91f1cd21f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f52cf22e-4204-4b59-b9c6-964f5788d093 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-de67fbe2-cca8-430e-bf3c-1a4904848285" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f52cf22e-4204-4b59-b9c6-964f5788d093 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-de67fbe2-cca8-430e-bf3c-1a4904848285" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f52cf22e-4204-4b59-b9c6-964f5788d093 tempest-ProjectMemberTests-607392192 None] Deleting offline snapshot de67fbe2-cca8-430e-bf3c-1a4904848285 of volume 56d930c2-67b8-45b9-9492-bda91f1cd21f {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:28:30 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f52cf22e-4204-4b59-b9c6-964f5788d093 tempest-ProjectMemberTests-607392192 None] snapshot_file for this snap is: volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.de67fbe2-cca8-430e-bf3c-1a4904848285 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60" returned: 0 in 0.464s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80fa7e5-a1c4-4116-893b-e7f670ebf7a7]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f52cf22e-4204-4b59-b9c6-964f5788d093 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.de67fbe2-cca8-430e-bf3c-1a4904848285 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[495e3d4e-85ea-489b-88a4-739e318c9ef7]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:30 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.de67fbe2-cca8-430e-bf3c-1a4904848285 Sep 23 15:28:30 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:30 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 Sep 23 15:28:30 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:30 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:31 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83" returned: 0 in 0.433s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 15:28:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Creating direct copy from snapshot {{(pid=86064) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 15:28:31 devstack cinder-volume[86064]: DEBUG cinder.utils [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Path /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa not found in is_blk_device check {{(pid=86064) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 15:28:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f52cf22e-4204-4b59-b9c6-964f5788d093 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.de67fbe2-cca8-430e-bf3c-1a4904848285" returned: 0 in 0.462s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f52cf22e-4204-4b59-b9c6-964f5788d093 tempest-ProjectMemberTests-607392192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56d930c2-67b8-45b9-9492-bda91f1cd21f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:28:31 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa Sep 23 15:28:31 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:31 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf9243b-3907-4264-b2e0-ea420a40d439]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f52cf22e-4204-4b59-b9c6-964f5788d093 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:31 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f Sep 23 15:28:31 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:31 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f52cf22e-4204-4b59-b9c6-964f5788d093 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f" returned: 0 in 0.410s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f52cf22e-4204-4b59-b9c6-964f5788d093 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.de67fbe2-cca8-430e-bf3c-1a4904848285 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:31 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.de67fbe2-cca8-430e-bf3c-1a4904848285 Sep 23 15:28:31 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:32 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f52cf22e-4204-4b59-b9c6-964f5788d093 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.de67fbe2-cca8-430e-bf3c-1a4904848285" returned: 0 in 0.652s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f52cf22e-4204-4b59-b9c6-964f5788d093 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.de67fbe2-cca8-430e-bf3c-1a4904848285 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:32 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.de67fbe2-cca8-430e-bf3c-1a4904848285 Sep 23 15:28:32 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:32 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:32 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f52cf22e-4204-4b59-b9c6-964f5788d093 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f.de67fbe2-cca8-430e-bf3c-1a4904848285" returned: 0 in 0.387s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f52cf22e-4204-4b59-b9c6-964f5788d093 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-de67fbe2-cca8-430e-bf3c-1a4904848285" released by "_delete_snapshot" :: held 2.079s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f52cf22e-4204-4b59-b9c6-964f5788d093 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-56d930c2-67b8-45b9-9492-bda91f1cd21f" released by "delete_snapshot" :: held 2.113s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:32 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-f52cf22e-4204-4b59-b9c6-964f5788d093 tempest-ProjectMemberTests-607392192 None] Created reservations ['2b5bc0a0-85f3-4ec3-b409-eb8365005bfa', '23337b0b-2ef4-4b8b-a868-8abbe059a8fd', '32ffb741-7643-44b5-9dce-843433758814', 'c571a632-06c4-407d-a4aa-bb497a2eaec5'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:32 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f52cf22e-4204-4b59-b9c6-964f5788d093 tempest-ProjectMemberTests-607392192 None] Delete snapshot completed successfully. Sep 23 15:28:32 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f52cf22e-4204-4b59-b9c6-964f5788d093 tempest-ProjectMemberTests-607392192 None] Lock "cinder-de67fbe2-cca8-430e-bf3c-1a4904848285-delete_snapshot" released by "delete_snapshot" :: held 2.388s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aa4b1c20-09bd-48e2-8b6b-32348d6f2334 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-56d930c2-67b8-45b9-9492-bda91f1cd21f-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aa4b1c20-09bd-48e2-8b6b-32348d6f2334 tempest-ProjectMemberTests-607392192 None] Lock "cinder-56d930c2-67b8-45b9-9492-bda91f1cd21f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aa4b1c20-09bd-48e2-8b6b-32348d6f2334 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-56d930c2-67b8-45b9-9492-bda91f1cd21f" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:33 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aa4b1c20-09bd-48e2-8b6b-32348d6f2334 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-56d930c2-67b8-45b9-9492-bda91f1cd21f" acquired by "delete_volume" :: waited 0.037s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:34 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ff40ce-cca0-4e83-a1fa-1208bcf34bbe]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aa4b1c20-09bd-48e2-8b6b-32348d6f2334 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:34 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f Sep 23 15:28:34 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:34 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aa4b1c20-09bd-48e2-8b6b-32348d6f2334 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f" returned: 0 in 0.583s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:34 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aa4b1c20-09bd-48e2-8b6b-32348d6f2334 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:34 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f Sep 23 15:28:34 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:35 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aa4b1c20-09bd-48e2-8b6b-32348d6f2334 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-56d930c2-67b8-45b9-9492-bda91f1cd21f" returned: 0 in 0.373s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aa4b1c20-09bd-48e2-8b6b-32348d6f2334 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-56d930c2-67b8-45b9-9492-bda91f1cd21f" released by "delete_volume" :: held 1.084s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:35 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-aa4b1c20-09bd-48e2-8b6b-32348d6f2334 tempest-ProjectMemberTests-607392192 None] Created reservations ['104dfe37-d68a-423d-8435-257dbe6dc817', 'da84a325-54b6-4b63-ad9d-c5ac7398fdda', '699b7618-dd72-4f84-a47d-637ffae61c6b', 'b9749ed7-c5df-45d6-9ca2-500fdce81c3d'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-aa4b1c20-09bd-48e2-8b6b-32348d6f2334 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-aa4b1c20-09bd-48e2-8b6b-32348d6f2334 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-aa4b1c20-09bd-48e2-8b6b-32348d6f2334 tempest-ProjectMemberTests-607392192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:35 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-aa4b1c20-09bd-48e2-8b6b-32348d6f2334 tempest-ProjectMemberTests-607392192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-aa4b1c20-09bd-48e2-8b6b-32348d6f2334 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aa4b1c20-09bd-48e2-8b6b-32348d6f2334 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:35 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:28:35 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:35 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:35 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-aa4b1c20-09bd-48e2-8b6b-32348d6f2334 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.365s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:35 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-aa4b1c20-09bd-48e2-8b6b-32348d6f2334 tempest-ProjectMemberTests-607392192 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:28:35 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-aa4b1c20-09bd-48e2-8b6b-32348d6f2334 tempest-ProjectMemberTests-607392192 None] Deleted volume successfully. Sep 23 15:28:35 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-aa4b1c20-09bd-48e2-8b6b-32348d6f2334 tempest-ProjectMemberTests-607392192 None] Lock "cinder-56d930c2-67b8-45b9-9492-bda91f1cd21f-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:28:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:36 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:28:36 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:36 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.438s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:28:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:28:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 28 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:28:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:28:37 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:28:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Flow 'volume_create_manager' (af97308d-9d37-4bf5-967b-012422574400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04cad54f-3bba-42d7-af16-a2a2a15a0090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04cad54f-3bba-42d7-af16-a2a2a15a0090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2049783298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6d2658-ccaf-466a-a27f-063bec9054c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66989f39c71404c9b228b7946437c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:37Z,use_quota=True,user_id='1a89078dd833490e8539b9c452c2a583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f35239-1913-4087-989d-a7a9c0ddc7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f35239-1913-4087-989d-a7a9c0ddc7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443d5494-612f-4068-83d5-8018cc384c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443d5494-612f-4068-83d5-8018cc384c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a6d2658-ccaf-466a-a27f-063bec9054c2', 'volume_name': 'volume-0a6d2658-ccaf-466a-a27f-063bec9054c2', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c747f092-65ce-4fcb-888d-3dbf3e40db69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c747f092-65ce-4fcb-888d-3dbf3e40db69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:37 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bea98b5-e443-474e-92c0-79c613a30ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:37 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Volume 0a6d2658-ccaf-466a-a27f-063bec9054c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a6d2658-ccaf-466a-a27f-063bec9054c2', 'volume_size': 1} Sep 23 15:28:37 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:38 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa" returned: 0 in 7.225s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG cinder.image.image_utils [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83, size 1024.00 MB, duration 7.23 sec, destination /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa {{(pid=86064) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 15:28:38 devstack cinder-volume[86064]: INFO cinder.image.image_utils [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Converted 1024.00 MB image at 141.70 MB/s Sep 23 15:28:38 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa is being set with open permissions: ugo+rw Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:38 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa Sep 23 15:28:38 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:38 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa" returned: 0 in 0.255s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Lock "cinder-quobyte-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa" released by "_copy_volume_from_snapshot" :: held 8.484s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Lock "cinder-quobyte-4f5476bc-c4aa-4460-ba46-b725be6cfa60-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa" released by "_create_volume_from_snapshot" :: held 8.551s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.576s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.950s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551147058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd8d790-231f-42db-967c-cda3100e98c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fde52c53113485f85c9f1f77a36927e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:28Z,use_quota=True,user_id='90a09068610840cfbdf2be72dd01f471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Creating volume abd8d790-231f-42db-967c-cda3100e98c2 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:28:38 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:38 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2 1073741824 Sep 23 15:28:38 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb4728d4-c21a-4bbf-b47b-e07076544131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa', 'volume_size': 1, 'snapshot_id': '4f5476bc-c4aa-4460-ba46-b725be6cfa60'}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da012025-99bf-415f-9e0e-b9dbe733339a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:38 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Volume volume-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa (eeb68ce0-80cb-4836-b990-c3f0f53d6cfa): created successfully Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da012025-99bf-415f-9e0e-b9dbe733339a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Flow 'volume_create_manager' (f1569c79-6a3b-42d5-a243-bc8852d4ae08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:38 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f9e9f10e-808d-49cd-8142-ffd7590cf9ad tempest-SnapshotDependencyTests-1915015512 None] Created volume successfully. Sep 23 15:28:38 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2 1073741824" returned: 0 in 0.414s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:38 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:39 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2 Sep 23 15:28:39 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:39 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2" returned: 0 in 0.250s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.066s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2049783298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6d2658-ccaf-466a-a27f-063bec9054c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66989f39c71404c9b228b7946437c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:37Z,use_quota=True,user_id='1a89078dd833490e8539b9c452c2a583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Creating volume 0a6d2658-ccaf-466a-a27f-063bec9054c2 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:28:39 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae30173c-1115-427c-a27a-ae79c0522681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abd8d790-231f-42db-967c-cda3100e98c2', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5be1c2-b37e-4f58-95d8-f5b898a86a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:39 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2 1073741824 Sep 23 15:28:39 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:39 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Volume volume-abd8d790-231f-42db-967c-cda3100e98c2 (abd8d790-231f-42db-967c-cda3100e98c2): created successfully Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5be1c2-b37e-4f58-95d8-f5b898a86a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Flow 'volume_create_manager' (e4de7816-8d83-4d8d-96f3-c98547727dc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:39 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-49d6cc7b-9ac3-49e0-a3c4-f8388ff881ab tempest-ProjectReaderTests-498698692 None] Created volume successfully. Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bfda3c06-a428-4bf6-aecb-942dded4d7fd tempest-SnapshotDependencyTests-1915015512 None] Acquiring lock "cinder-4f5476bc-c4aa-4460-ba46-b725be6cfa60-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:39 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2 1073741824" returned: 0 in 0.456s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bfda3c06-a428-4bf6-aecb-942dded4d7fd tempest-SnapshotDependencyTests-1915015512 None] Lock "cinder-4f5476bc-c4aa-4460-ba46-b725be6cfa60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bfda3c06-a428-4bf6-aecb-942dded4d7fd tempest-SnapshotDependencyTests-1915015512 None] Acquiring lock "cinder-quobyte-da172bd6-ee94-41cf-9ca7-03b0a7a41b83" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bfda3c06-a428-4bf6-aecb-942dded4d7fd tempest-SnapshotDependencyTests-1915015512 None] Lock "cinder-quobyte-da172bd6-ee94-41cf-9ca7-03b0a7a41b83" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bfda3c06-a428-4bf6-aecb-942dded4d7fd tempest-SnapshotDependencyTests-1915015512 None] Acquiring lock "cinder-quobyte-4f5476bc-c4aa-4460-ba46-b725be6cfa60" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bfda3c06-a428-4bf6-aecb-942dded4d7fd tempest-SnapshotDependencyTests-1915015512 None] Lock "cinder-quobyte-4f5476bc-c4aa-4460-ba46-b725be6cfa60" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-bfda3c06-a428-4bf6-aecb-942dded4d7fd tempest-SnapshotDependencyTests-1915015512 None] Deleting offline snapshot 4f5476bc-c4aa-4460-ba46-b725be6cfa60 of volume da172bd6-ee94-41cf-9ca7-03b0a7a41b83 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:28:39 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2 Sep 23 15:28:39 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-bfda3c06-a428-4bf6-aecb-942dded4d7fd tempest-SnapshotDependencyTests-1915015512 None] snapshot_file for this snap is: volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f3d11e-54df-497e-b887-85ed108ec314]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:39 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bfda3c06-a428-4bf6-aecb-942dded4d7fd tempest-SnapshotDependencyTests-1915015512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:39 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60 Sep 23 15:28:39 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:40 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2" returned: 0 in 0.255s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:40 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:28:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:40 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bea98b5-e443-474e-92c0-79c613a30ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a6d2658-ccaf-466a-a27f-063bec9054c2', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:40 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd9ca7a-890a-43b5-84d8-3dec0f127611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:40 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Volume volume-0a6d2658-ccaf-466a-a27f-063bec9054c2 (0a6d2658-ccaf-466a-a27f-063bec9054c2): created successfully Sep 23 15:28:40 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd9ca7a-890a-43b5-84d8-3dec0f127611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:40 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Flow 'volume_create_manager' (af97308d-9d37-4bf5-967b-012422574400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:40 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-c2b366d8-6993-4c29-89d0-99c380b7cd76 tempest-ProjectMemberTests-607392192 None] Created volume successfully. Sep 23 15:28:40 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bfda3c06-a428-4bf6-aecb-942dded4d7fd tempest-SnapshotDependencyTests-1915015512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60" returned: 0 in 0.415s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:40 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-bfda3c06-a428-4bf6-aecb-942dded4d7fd tempest-SnapshotDependencyTests-1915015512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:28:40 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f806b9a-154a-4156-91ad-a409f804b9f6]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bfda3c06-a428-4bf6-aecb-942dded4d7fd tempest-SnapshotDependencyTests-1915015512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:40 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 Sep 23 15:28:40 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f5e0e6e1-7568-4373-97a8-230f965aa733 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f5e0e6e1-7568-4373-97a8-230f965aa733 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:40 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f5e0e6e1-7568-4373-97a8-230f965aa733 tempest-ProjectMemberTests-607392192 None] Creating offline snapshot 518c34dc-bfdb-4fd7-b826-55f70baa65ea of volume 0a6d2658-ccaf-466a-a27f-063bec9054c2 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:28:40 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea56718-b73b-42e8-8efd-58e3662a8441]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f5e0e6e1-7568-4373-97a8-230f965aa733 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7d9663c1-7228-4b17-b563-25bc4b0b9e76 tempest-ProjectReaderTests-498698692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:40 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2 Sep 23 15:28:40 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:40 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bfda3c06-a428-4bf6-aecb-942dded4d7fd tempest-SnapshotDependencyTests-1915015512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83" returned: 0 in 0.623s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bfda3c06-a428-4bf6-aecb-942dded4d7fd tempest-SnapshotDependencyTests-1915015512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:40 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f5e0e6e1-7568-4373-97a8-230f965aa733 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2" returned: 0 in 0.414s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:40 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f5e0e6e1-7568-4373-97a8-230f965aa733 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.518c34dc-bfdb-4fd7-b826-55f70baa65ea 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:40 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60 Sep 23 15:28:40 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:40 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.518c34dc-bfdb-4fd7-b826-55f70baa65ea 1G Sep 23 15:28:40 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:41 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bfda3c06-a428-4bf6-aecb-942dded4d7fd tempest-SnapshotDependencyTests-1915015512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60" returned: 0 in 0.348s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bfda3c06-a428-4bf6-aecb-942dded4d7fd tempest-SnapshotDependencyTests-1915015512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:41 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60 Sep 23 15:28:41 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:41 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f5e0e6e1-7568-4373-97a8-230f965aa733 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.518c34dc-bfdb-4fd7-b826-55f70baa65ea 1G" returned: 0 in 0.435s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f5e0e6e1-7568-4373-97a8-230f965aa733 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a6d2658-ccaf-466a-a27f-063bec9054c2 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.518c34dc-bfdb-4fd7-b826-55f70baa65ea {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:41 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a6d2658-ccaf-466a-a27f-063bec9054c2 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.518c34dc-bfdb-4fd7-b826-55f70baa65ea Sep 23 15:28:41 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:41 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-bfda3c06-a428-4bf6-aecb-942dded4d7fd tempest-SnapshotDependencyTests-1915015512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83.4f5476bc-c4aa-4460-ba46-b725be6cfa60" returned: 0 in 0.265s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bfda3c06-a428-4bf6-aecb-942dded4d7fd tempest-SnapshotDependencyTests-1915015512 None] Lock "cinder-quobyte-4f5476bc-c4aa-4460-ba46-b725be6cfa60" released by "_delete_snapshot" :: held 1.777s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bfda3c06-a428-4bf6-aecb-942dded4d7fd tempest-SnapshotDependencyTests-1915015512 None] Lock "cinder-quobyte-da172bd6-ee94-41cf-9ca7-03b0a7a41b83" released by "delete_snapshot" :: held 1.811s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:41 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-bfda3c06-a428-4bf6-aecb-942dded4d7fd tempest-SnapshotDependencyTests-1915015512 None] Created reservations ['757d88fc-92d7-4613-a459-4a6f0714e6af', 'e250fe7a-a539-40ea-b26c-0bd1976ce1be', 'b4833d61-6c4c-4e47-ab08-115b8d437184', '7e363e81-87a1-48f8-aad0-49fbdd358a63'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:41 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f5e0e6e1-7568-4373-97a8-230f965aa733 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a6d2658-ccaf-466a-a27f-063bec9054c2 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.518c34dc-bfdb-4fd7-b826-55f70baa65ea" returned: 0 in 0.326s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:41 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-f5e0e6e1-7568-4373-97a8-230f965aa733 tempest-ProjectMemberTests-607392192 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.518c34dc-bfdb-4fd7-b826-55f70baa65ea is being set with open permissions: ugo+rw Sep 23 15:28:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f5e0e6e1-7568-4373-97a8-230f965aa733 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.518c34dc-bfdb-4fd7-b826-55f70baa65ea {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:41 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.518c34dc-bfdb-4fd7-b826-55f70baa65ea Sep 23 15:28:41 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:41 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-bfda3c06-a428-4bf6-aecb-942dded4d7fd tempest-SnapshotDependencyTests-1915015512 None] Delete snapshot completed successfully. Sep 23 15:28:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-bfda3c06-a428-4bf6-aecb-942dded4d7fd tempest-SnapshotDependencyTests-1915015512 None] Lock "cinder-4f5476bc-c4aa-4460-ba46-b725be6cfa60-delete_snapshot" released by "delete_snapshot" :: held 1.984s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-76c2ebe2-26dc-425f-a0b4-850deddc56a8 tempest-SnapshotDependencyTests-1915015512 None] Acquiring lock "cinder-da172bd6-ee94-41cf-9ca7-03b0a7a41b83-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-76c2ebe2-26dc-425f-a0b4-850deddc56a8 tempest-SnapshotDependencyTests-1915015512 None] Lock "cinder-da172bd6-ee94-41cf-9ca7-03b0a7a41b83-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-76c2ebe2-26dc-425f-a0b4-850deddc56a8 tempest-SnapshotDependencyTests-1915015512 None] Acquiring lock "cinder-quobyte-da172bd6-ee94-41cf-9ca7-03b0a7a41b83" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:41 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:41 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f5e0e6e1-7568-4373-97a8-230f965aa733 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.518c34dc-bfdb-4fd7-b826-55f70baa65ea" returned: 0 in 0.277s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:41 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-76c2ebe2-26dc-425f-a0b4-850deddc56a8 tempest-SnapshotDependencyTests-1915015512 None] Lock "cinder-quobyte-da172bd6-ee94-41cf-9ca7-03b0a7a41b83" acquired by "delete_volume" :: waited 0.022s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f5e0e6e1-7568-4373-97a8-230f965aa733 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f5fd16-5475-4458-aef8-f2d72a43aed2]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-76c2ebe2-26dc-425f-a0b4-850deddc56a8 tempest-SnapshotDependencyTests-1915015512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:42 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.info Sep 23 15:28:42 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:42 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 Sep 23 15:28:42 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:42 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f5e0e6e1-7568-4373-97a8-230f965aa733 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.info" returned: 0 in 0.259s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:42 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-f5e0e6e1-7568-4373-97a8-230f965aa733 tempest-ProjectMemberTests-607392192 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.info is being set with open permissions: ugo+rw Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f5e0e6e1-7568-4373-97a8-230f965aa733 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:42 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.info Sep 23 15:28:42 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:42 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-76c2ebe2-26dc-425f-a0b4-850deddc56a8 tempest-SnapshotDependencyTests-1915015512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83" returned: 0 in 0.381s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-76c2ebe2-26dc-425f-a0b4-850deddc56a8 tempest-SnapshotDependencyTests-1915015512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:42 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83 Sep 23 15:28:42 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:42 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f5e0e6e1-7568-4373-97a8-230f965aa733 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.info" returned: 0 in 0.255s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f5e0e6e1-7568-4373-97a8-230f965aa733 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.095s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7d9663c1-7228-4b17-b563-25bc4b0b9e76 tempest-ProjectReaderTests-498698692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.918s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-7d9663c1-7228-4b17-b563-25bc4b0b9e76 tempest-ProjectReaderTests-498698692 None] Creating offline snapshot 26404561-46ea-41b0-9893-3e5f845db3a6 of volume abd8d790-231f-42db-967c-cda3100e98c2 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:28:42 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f5e0e6e1-7568-4373-97a8-230f965aa733 tempest-ProjectMemberTests-607392192 None] Create snapshot completed successfully Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[af155cf7-4d38-4f38-8714-e8f7153139e3]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7d9663c1-7228-4b17-b563-25bc4b0b9e76 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:42 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-76c2ebe2-26dc-425f-a0b4-850deddc56a8 tempest-SnapshotDependencyTests-1915015512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-da172bd6-ee94-41cf-9ca7-03b0a7a41b83" returned: 0 in 0.282s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-76c2ebe2-26dc-425f-a0b4-850deddc56a8 tempest-SnapshotDependencyTests-1915015512 None] Lock "cinder-quobyte-da172bd6-ee94-41cf-9ca7-03b0a7a41b83" released by "delete_volume" :: held 0.738s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:42 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2 Sep 23 15:28:42 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-76c2ebe2-26dc-425f-a0b4-850deddc56a8 tempest-SnapshotDependencyTests-1915015512 None] Created reservations ['afc9fe13-3aec-4db4-bd1f-faa0632923b6', '5fc27797-1a4e-45fd-9598-588bcc6f0d71', 'c12c62f9-81ff-44ab-bfe1-f84206f0b960', 'f7d07bde-44c5-4251-9b7d-08ed40ed7f22'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-76c2ebe2-26dc-425f-a0b4-850deddc56a8 tempest-SnapshotDependencyTests-1915015512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-76c2ebe2-26dc-425f-a0b4-850deddc56a8 tempest-SnapshotDependencyTests-1915015512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-76c2ebe2-26dc-425f-a0b4-850deddc56a8 tempest-SnapshotDependencyTests-1915015512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-76c2ebe2-26dc-425f-a0b4-850deddc56a8 tempest-SnapshotDependencyTests-1915015512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-76c2ebe2-26dc-425f-a0b4-850deddc56a8 tempest-SnapshotDependencyTests-1915015512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-76c2ebe2-26dc-425f-a0b4-850deddc56a8 tempest-SnapshotDependencyTests-1915015512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:42 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:28:42 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:42 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7d9663c1-7228-4b17-b563-25bc4b0b9e76 tempest-ProjectReaderTests-498698692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2" returned: 0 in 0.382s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:42 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7d9663c1-7228-4b17-b563-25bc4b0b9e76 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.26404561-46ea-41b0-9893-3e5f845db3a6 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:43 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.26404561-46ea-41b0-9893-3e5f845db3a6 1G Sep 23 15:28:43 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d762e58d-90d8-4494-8897-9c28bd705206 tempest-SnapshotDependencyTests-1915015512 None] Acquiring lock "cinder-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:43 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-76c2ebe2-26dc-425f-a0b4-850deddc56a8 tempest-SnapshotDependencyTests-1915015512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.272s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-76c2ebe2-26dc-425f-a0b4-850deddc56a8 tempest-SnapshotDependencyTests-1915015512 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d762e58d-90d8-4494-8897-9c28bd705206 tempest-SnapshotDependencyTests-1915015512 None] Lock "cinder-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:43 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-76c2ebe2-26dc-425f-a0b4-850deddc56a8 tempest-SnapshotDependencyTests-1915015512 None] Deleted volume successfully. Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-76c2ebe2-26dc-425f-a0b4-850deddc56a8 tempest-SnapshotDependencyTests-1915015512 None] Lock "cinder-da172bd6-ee94-41cf-9ca7-03b0a7a41b83-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d762e58d-90d8-4494-8897-9c28bd705206 tempest-SnapshotDependencyTests-1915015512 None] Acquiring lock "cinder-quobyte-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d762e58d-90d8-4494-8897-9c28bd705206 tempest-SnapshotDependencyTests-1915015512 None] Lock "cinder-quobyte-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa" acquired by "delete_volume" :: waited 0.015s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[699e6568-26fb-4ff1-8109-b1c0ff904730]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d762e58d-90d8-4494-8897-9c28bd705206 tempest-SnapshotDependencyTests-1915015512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:43 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa Sep 23 15:28:43 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:43 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7d9663c1-7228-4b17-b563-25bc4b0b9e76 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.26404561-46ea-41b0-9893-3e5f845db3a6 1G" returned: 0 in 0.445s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7d9663c1-7228-4b17-b563-25bc4b0b9e76 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd8d790-231f-42db-967c-cda3100e98c2 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.26404561-46ea-41b0-9893-3e5f845db3a6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:43 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd8d790-231f-42db-967c-cda3100e98c2 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.26404561-46ea-41b0-9893-3e5f845db3a6 Sep 23 15:28:43 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:43 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d762e58d-90d8-4494-8897-9c28bd705206 tempest-SnapshotDependencyTests-1915015512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa" returned: 0 in 0.409s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d762e58d-90d8-4494-8897-9c28bd705206 tempest-SnapshotDependencyTests-1915015512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d0a41b8b-8f8e-4a17-ba3c-4fe58973356f tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-518c34dc-bfdb-4fd7-b826-55f70baa65ea-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:43 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa Sep 23 15:28:43 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d0a41b8b-8f8e-4a17-ba3c-4fe58973356f tempest-ProjectMemberTests-607392192 None] Lock "cinder-518c34dc-bfdb-4fd7-b826-55f70baa65ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d0a41b8b-8f8e-4a17-ba3c-4fe58973356f tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-0a6d2658-ccaf-466a-a27f-063bec9054c2" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d0a41b8b-8f8e-4a17-ba3c-4fe58973356f tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-0a6d2658-ccaf-466a-a27f-063bec9054c2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d0a41b8b-8f8e-4a17-ba3c-4fe58973356f tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-518c34dc-bfdb-4fd7-b826-55f70baa65ea" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d0a41b8b-8f8e-4a17-ba3c-4fe58973356f tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-518c34dc-bfdb-4fd7-b826-55f70baa65ea" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-d0a41b8b-8f8e-4a17-ba3c-4fe58973356f tempest-ProjectMemberTests-607392192 None] Deleting offline snapshot 518c34dc-bfdb-4fd7-b826-55f70baa65ea of volume 0a6d2658-ccaf-466a-a27f-063bec9054c2 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-d0a41b8b-8f8e-4a17-ba3c-4fe58973356f tempest-ProjectMemberTests-607392192 None] snapshot_file for this snap is: volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.518c34dc-bfdb-4fd7-b826-55f70baa65ea {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd88637-c8dc-45a8-bdb6-f7ef79b388e1]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d0a41b8b-8f8e-4a17-ba3c-4fe58973356f tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.518c34dc-bfdb-4fd7-b826-55f70baa65ea {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:43 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7d9663c1-7228-4b17-b563-25bc4b0b9e76 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd8d790-231f-42db-967c-cda3100e98c2 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.26404561-46ea-41b0-9893-3e5f845db3a6" returned: 0 in 0.358s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:43 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-7d9663c1-7228-4b17-b563-25bc4b0b9e76 tempest-ProjectReaderTests-498698692 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.26404561-46ea-41b0-9893-3e5f845db3a6 is being set with open permissions: ugo+rw Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7d9663c1-7228-4b17-b563-25bc4b0b9e76 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.26404561-46ea-41b0-9893-3e5f845db3a6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:43 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.26404561-46ea-41b0-9893-3e5f845db3a6 Sep 23 15:28:43 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:43 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.518c34dc-bfdb-4fd7-b826-55f70baa65ea Sep 23 15:28:43 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:43 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d762e58d-90d8-4494-8897-9c28bd705206 tempest-SnapshotDependencyTests-1915015512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa" returned: 0 in 0.294s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d762e58d-90d8-4494-8897-9c28bd705206 tempest-SnapshotDependencyTests-1915015512 None] Lock "cinder-quobyte-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa" released by "delete_volume" :: held 0.754s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:43 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-d762e58d-90d8-4494-8897-9c28bd705206 tempest-SnapshotDependencyTests-1915015512 None] Created reservations ['404a0605-65ea-43b9-a75d-e241e7ac43ed', 'f374e804-fdec-42b3-99da-2a87adf47958', '9c1c0160-6326-4122-be08-944e96f46112', '853b4328-c355-4ab9-b9b7-14408c997cf9'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:44 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d762e58d-90d8-4494-8897-9c28bd705206 tempest-SnapshotDependencyTests-1915015512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d762e58d-90d8-4494-8897-9c28bd705206 tempest-SnapshotDependencyTests-1915015512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:44 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d762e58d-90d8-4494-8897-9c28bd705206 tempest-SnapshotDependencyTests-1915015512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:44 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-d762e58d-90d8-4494-8897-9c28bd705206 tempest-SnapshotDependencyTests-1915015512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-d762e58d-90d8-4494-8897-9c28bd705206 tempest-SnapshotDependencyTests-1915015512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d762e58d-90d8-4494-8897-9c28bd705206 tempest-SnapshotDependencyTests-1915015512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7d9663c1-7228-4b17-b563-25bc4b0b9e76 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.26404561-46ea-41b0-9893-3e5f845db3a6" returned: 0 in 0.289s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:44 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:28:44 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7d9663c1-7228-4b17-b563-25bc4b0b9e76 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:44 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.info Sep 23 15:28:44 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:44 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d0a41b8b-8f8e-4a17-ba3c-4fe58973356f tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.518c34dc-bfdb-4fd7-b826-55f70baa65ea" returned: 0 in 0.441s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:44 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-d0a41b8b-8f8e-4a17-ba3c-4fe58973356f tempest-ProjectMemberTests-607392192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a6d2658-ccaf-466a-a27f-063bec9054c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:28:44 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ec1107-5fd8-40b8-b2d2-87c5efd8fc2a]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d0a41b8b-8f8e-4a17-ba3c-4fe58973356f tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:44 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:44 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2 Sep 23 15:28:44 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d762e58d-90d8-4494-8897-9c28bd705206 tempest-SnapshotDependencyTests-1915015512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.296s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:44 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-d762e58d-90d8-4494-8897-9c28bd705206 tempest-SnapshotDependencyTests-1915015512 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:28:44 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-d762e58d-90d8-4494-8897-9c28bd705206 tempest-SnapshotDependencyTests-1915015512 None] Deleted volume successfully. Sep 23 15:28:44 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d762e58d-90d8-4494-8897-9c28bd705206 tempest-SnapshotDependencyTests-1915015512 None] Lock "cinder-eeb68ce0-80cb-4836-b990-c3f0f53d6cfa-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:44 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7d9663c1-7228-4b17-b563-25bc4b0b9e76 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.info" returned: 0 in 0.327s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:44 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-7d9663c1-7228-4b17-b563-25bc4b0b9e76 tempest-ProjectReaderTests-498698692 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.info is being set with open permissions: ugo+rw Sep 23 15:28:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7d9663c1-7228-4b17-b563-25bc4b0b9e76 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:44 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.info Sep 23 15:28:44 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:44 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d0a41b8b-8f8e-4a17-ba3c-4fe58973356f tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2" returned: 0 in 0.404s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d0a41b8b-8f8e-4a17-ba3c-4fe58973356f tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.518c34dc-bfdb-4fd7-b826-55f70baa65ea {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:44 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.518c34dc-bfdb-4fd7-b826-55f70baa65ea Sep 23 15:28:44 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:44 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7d9663c1-7228-4b17-b563-25bc4b0b9e76 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.info" returned: 0 in 0.265s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:44 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7d9663c1-7228-4b17-b563-25bc4b0b9e76 tempest-ProjectReaderTests-498698692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.185s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:44 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7d9663c1-7228-4b17-b563-25bc4b0b9e76 tempest-ProjectReaderTests-498698692 None] Create snapshot completed successfully Sep 23 15:28:45 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d0a41b8b-8f8e-4a17-ba3c-4fe58973356f tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.518c34dc-bfdb-4fd7-b826-55f70baa65ea" returned: 0 in 0.367s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d0a41b8b-8f8e-4a17-ba3c-4fe58973356f tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.518c34dc-bfdb-4fd7-b826-55f70baa65ea {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:45 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.518c34dc-bfdb-4fd7-b826-55f70baa65ea Sep 23 15:28:45 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:45 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:45 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-d0a41b8b-8f8e-4a17-ba3c-4fe58973356f tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2.518c34dc-bfdb-4fd7-b826-55f70baa65ea" returned: 0 in 0.289s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d0a41b8b-8f8e-4a17-ba3c-4fe58973356f tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-518c34dc-bfdb-4fd7-b826-55f70baa65ea" released by "_delete_snapshot" :: held 1.629s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d0a41b8b-8f8e-4a17-ba3c-4fe58973356f tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-0a6d2658-ccaf-466a-a27f-063bec9054c2" released by "delete_snapshot" :: held 1.661s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:45 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-d0a41b8b-8f8e-4a17-ba3c-4fe58973356f tempest-ProjectMemberTests-607392192 None] Created reservations ['3f73f42e-f6a4-4e15-9dc1-cdea97270330', 'd13b6241-9d21-486f-a419-34af493eda24', 'c0941c17-792c-4d62-8851-41a51a2d13d2', '0702202a-e6b6-4247-af6f-d6a2ad6bc9a2'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:45 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-d0a41b8b-8f8e-4a17-ba3c-4fe58973356f tempest-ProjectMemberTests-607392192 None] Delete snapshot completed successfully. Sep 23 15:28:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-d0a41b8b-8f8e-4a17-ba3c-4fe58973356f tempest-ProjectMemberTests-607392192 None] Lock "cinder-518c34dc-bfdb-4fd7-b826-55f70baa65ea-delete_snapshot" released by "delete_snapshot" :: held 1.806s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2c0ab81a-b2d8-4597-ae1c-47b20447b7fa tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-0a6d2658-ccaf-466a-a27f-063bec9054c2-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2c0ab81a-b2d8-4597-ae1c-47b20447b7fa tempest-ProjectMemberTests-607392192 None] Lock "cinder-0a6d2658-ccaf-466a-a27f-063bec9054c2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:45 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2c0ab81a-b2d8-4597-ae1c-47b20447b7fa tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-0a6d2658-ccaf-466a-a27f-063bec9054c2" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2c0ab81a-b2d8-4597-ae1c-47b20447b7fa tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-0a6d2658-ccaf-466a-a27f-063bec9054c2" acquired by "delete_volume" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:46 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf22322-97d1-4c0a-a4ab-3ebbe0442d72]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2c0ab81a-b2d8-4597-ae1c-47b20447b7fa tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:46 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2 Sep 23 15:28:46 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a7faa655-479d-4399-a66b-30d0b6785f2c tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-26404561-46ea-41b0-9893-3e5f845db3a6-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a7faa655-479d-4399-a66b-30d0b6785f2c tempest-ProjectReaderTests-498698692 None] Lock "cinder-26404561-46ea-41b0-9893-3e5f845db3a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a7faa655-479d-4399-a66b-30d0b6785f2c tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-quobyte-abd8d790-231f-42db-967c-cda3100e98c2" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a7faa655-479d-4399-a66b-30d0b6785f2c tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-abd8d790-231f-42db-967c-cda3100e98c2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a7faa655-479d-4399-a66b-30d0b6785f2c tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-quobyte-26404561-46ea-41b0-9893-3e5f845db3a6" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a7faa655-479d-4399-a66b-30d0b6785f2c tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-26404561-46ea-41b0-9893-3e5f845db3a6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-a7faa655-479d-4399-a66b-30d0b6785f2c tempest-ProjectReaderTests-498698692 None] Deleting offline snapshot 26404561-46ea-41b0-9893-3e5f845db3a6 of volume abd8d790-231f-42db-967c-cda3100e98c2 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:28:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-a7faa655-479d-4399-a66b-30d0b6785f2c tempest-ProjectReaderTests-498698692 None] snapshot_file for this snap is: volume-abd8d790-231f-42db-967c-cda3100e98c2.26404561-46ea-41b0-9893-3e5f845db3a6 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:28:46 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[80309397-3a2d-447c-8db2-843b893b099e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a7faa655-479d-4399-a66b-30d0b6785f2c tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.26404561-46ea-41b0-9893-3e5f845db3a6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:46 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2c0ab81a-b2d8-4597-ae1c-47b20447b7fa tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2" returned: 0 in 0.431s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2c0ab81a-b2d8-4597-ae1c-47b20447b7fa tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:46 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.26404561-46ea-41b0-9893-3e5f845db3a6 Sep 23 15:28:46 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:46 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2 Sep 23 15:28:46 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:46 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2c0ab81a-b2d8-4597-ae1c-47b20447b7fa tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-0a6d2658-ccaf-466a-a27f-063bec9054c2" returned: 0 in 0.286s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:46 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:46 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2c0ab81a-b2d8-4597-ae1c-47b20447b7fa tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-0a6d2658-ccaf-466a-a27f-063bec9054c2" released by "delete_volume" :: held 0.799s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a7faa655-479d-4399-a66b-30d0b6785f2c tempest-ProjectReaderTests-498698692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.26404561-46ea-41b0-9893-3e5f845db3a6" returned: 0 in 0.422s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:46 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-a7faa655-479d-4399-a66b-30d0b6785f2c tempest-ProjectReaderTests-498698692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abd8d790-231f-42db-967c-cda3100e98c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:28:46 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef51f10-3408-468c-9356-ee8050e1795e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:46 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a7faa655-479d-4399-a66b-30d0b6785f2c tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:46 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-2c0ab81a-b2d8-4597-ae1c-47b20447b7fa tempest-ProjectMemberTests-607392192 None] Created reservations ['9c6037e7-fe77-4559-bd65-fb6ed01a46b5', 'f53873fa-17f9-41cd-abc4-fc023e5b7214', 'fd11f41e-8fe2-414d-b942-2451b2c8b455', 'b4f585c3-2bed-477d-b91c-8a8ced2a1cf7'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:46 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2 Sep 23 15:28:46 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2c0ab81a-b2d8-4597-ae1c-47b20447b7fa tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2c0ab81a-b2d8-4597-ae1c-47b20447b7fa tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2c0ab81a-b2d8-4597-ae1c-47b20447b7fa tempest-ProjectMemberTests-607392192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-2c0ab81a-b2d8-4597-ae1c-47b20447b7fa tempest-ProjectMemberTests-607392192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-2c0ab81a-b2d8-4597-ae1c-47b20447b7fa tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2c0ab81a-b2d8-4597-ae1c-47b20447b7fa tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:47 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:28:47 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:47 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-2c0ab81a-b2d8-4597-ae1c-47b20447b7fa tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.344s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-2c0ab81a-b2d8-4597-ae1c-47b20447b7fa tempest-ProjectMemberTests-607392192 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:28:47 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-2c0ab81a-b2d8-4597-ae1c-47b20447b7fa tempest-ProjectMemberTests-607392192 None] Deleted volume successfully. Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-2c0ab81a-b2d8-4597-ae1c-47b20447b7fa tempest-ProjectMemberTests-607392192 None] Lock "cinder-0a6d2658-ccaf-466a-a27f-063bec9054c2-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:47 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a7faa655-479d-4399-a66b-30d0b6785f2c tempest-ProjectReaderTests-498698692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2" returned: 0 in 0.555s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a7faa655-479d-4399-a66b-30d0b6785f2c tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.26404561-46ea-41b0-9893-3e5f845db3a6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:47 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.26404561-46ea-41b0-9893-3e5f845db3a6 Sep 23 15:28:47 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Flow 'volume_create_manager' (7aa6652f-b52b-431b-a9e8-6efb8b3e629d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb5ed4e-3db8-46d8-9f0f-40a2720294a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb5ed4e-3db8-46d8-9f0f-40a2720294a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-75386769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabebd06-4b3e-470a-a81a-8ec110746fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66989f39c71404c9b228b7946437c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:48Z,use_quota=True,user_id='1a89078dd833490e8539b9c452c2a583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55127e61-99b2-42a9-b3b2-1c9c6f54fbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55127e61-99b2-42a9-b3b2-1c9c6f54fbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800cdee4-1c65-49a1-b6d9-70dc2a6f94c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800cdee4-1c65-49a1-b6d9-70dc2a6f94c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fabebd06-4b3e-470a-a81a-8ec110746fd6', 'volume_name': 'volume-fabebd06-4b3e-470a-a81a-8ec110746fd6', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70486578-8341-424a-8bca-50a2182877c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70486578-8341-424a-8bca-50a2182877c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fadd8318-edfd-43e0-b8db-c53396ac3fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:47 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Volume fabebd06-4b3e-470a-a81a-8ec110746fd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fabebd06-4b3e-470a-a81a-8ec110746fd6', 'volume_size': 1} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-75386769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabebd06-4b3e-470a-a81a-8ec110746fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66989f39c71404c9b228b7946437c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:48Z,use_quota=True,user_id='1a89078dd833490e8539b9c452c2a583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Creating volume fabebd06-4b3e-470a-a81a-8ec110746fd6 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:28:47 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:47 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a7faa655-479d-4399-a66b-30d0b6785f2c tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.26404561-46ea-41b0-9893-3e5f845db3a6" returned: 0 in 0.359s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:47 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a7faa655-479d-4399-a66b-30d0b6785f2c tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.26404561-46ea-41b0-9893-3e5f845db3a6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:47 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6 1073741824 Sep 23 15:28:47 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:47 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.26404561-46ea-41b0-9893-3e5f845db3a6 Sep 23 15:28:47 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:48 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a7faa655-479d-4399-a66b-30d0b6785f2c tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2.26404561-46ea-41b0-9893-3e5f845db3a6" returned: 0 in 0.255s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:48 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a7faa655-479d-4399-a66b-30d0b6785f2c tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-26404561-46ea-41b0-9893-3e5f845db3a6" released by "_delete_snapshot" :: held 1.729s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:48 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a7faa655-479d-4399-a66b-30d0b6785f2c tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-abd8d790-231f-42db-967c-cda3100e98c2" released by "delete_snapshot" :: held 1.754s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:48 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-a7faa655-479d-4399-a66b-30d0b6785f2c tempest-ProjectReaderTests-498698692 None] Created reservations ['e7d82c80-5fc7-47a4-8252-45cd0ed4be7b', '96b12763-6f0c-4e3a-91c3-1f5fc16087cd', '92980757-08fb-4af5-9655-d9e566ebf439', '4ab3a3ac-ab8d-4841-9956-50ef9a70b873'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:48 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-a7faa655-479d-4399-a66b-30d0b6785f2c tempest-ProjectReaderTests-498698692 None] Delete snapshot completed successfully. Sep 23 15:28:48 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-a7faa655-479d-4399-a66b-30d0b6785f2c tempest-ProjectReaderTests-498698692 None] Lock "cinder-26404561-46ea-41b0-9893-3e5f845db3a6-delete_snapshot" released by "delete_snapshot" :: held 1.964s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:48 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6 1073741824" returned: 0 in 0.532s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:48 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6 Sep 23 15:28:48 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:48 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5c480840-bc1a-4dbd-ad03-2b67826e94e3 tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-abd8d790-231f-42db-967c-cda3100e98c2-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:48 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5c480840-bc1a-4dbd-ad03-2b67826e94e3 tempest-ProjectReaderTests-498698692 None] Lock "cinder-abd8d790-231f-42db-967c-cda3100e98c2-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:48 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5c480840-bc1a-4dbd-ad03-2b67826e94e3 tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-quobyte-abd8d790-231f-42db-967c-cda3100e98c2" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:48 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5c480840-bc1a-4dbd-ad03-2b67826e94e3 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-abd8d790-231f-42db-967c-cda3100e98c2" acquired by "delete_volume" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:48 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6" returned: 0 in 0.360s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:48 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:28:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:48 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[848c94b4-c1d1-44a8-a2ec-1bf9bae95f11]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:48 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5c480840-bc1a-4dbd-ad03-2b67826e94e3 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fadd8318-edfd-43e0-b8db-c53396ac3fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fabebd06-4b3e-470a-a81a-8ec110746fd6', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791e1670-d035-4ae1-ae36-085c046c118c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:48 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Volume volume-fabebd06-4b3e-470a-a81a-8ec110746fd6 (fabebd06-4b3e-470a-a81a-8ec110746fd6): created successfully Sep 23 15:28:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791e1670-d035-4ae1-ae36-085c046c118c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:48 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Flow 'volume_create_manager' (7aa6652f-b52b-431b-a9e8-6efb8b3e629d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:48 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-9be79c39-565e-4132-bfe0-867e488f3e13 tempest-ProjectMemberTests-607392192 None] Created volume successfully. Sep 23 15:28:48 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2 Sep 23 15:28:48 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:49 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5c480840-bc1a-4dbd-ad03-2b67826e94e3 tempest-ProjectReaderTests-498698692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2" returned: 0 in 0.388s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5c480840-bc1a-4dbd-ad03-2b67826e94e3 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:49 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2 Sep 23 15:28:49 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:49 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5c480840-bc1a-4dbd-ad03-2b67826e94e3 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-abd8d790-231f-42db-967c-cda3100e98c2" returned: 0 in 0.288s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5c480840-bc1a-4dbd-ad03-2b67826e94e3 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-abd8d790-231f-42db-967c-cda3100e98c2" released by "delete_volume" :: held 0.752s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:49 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-5c480840-bc1a-4dbd-ad03-2b67826e94e3 tempest-ProjectReaderTests-498698692 None] Created reservations ['2114a0d7-5318-440a-b409-051da0fa10bc', 'ebef3545-76fc-4913-b061-3515bbe5980d', '4b113896-1335-4b22-b82e-6b1bebd37e39', 'beb74ffc-e73f-4b84-b415-c8f483982798'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5c480840-bc1a-4dbd-ad03-2b67826e94e3 tempest-ProjectReaderTests-498698692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5c480840-bc1a-4dbd-ad03-2b67826e94e3 tempest-ProjectReaderTests-498698692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5c480840-bc1a-4dbd-ad03-2b67826e94e3 tempest-ProjectReaderTests-498698692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:49 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-5c480840-bc1a-4dbd-ad03-2b67826e94e3 tempest-ProjectReaderTests-498698692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5c480840-bc1a-4dbd-ad03-2b67826e94e3 tempest-ProjectReaderTests-498698692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5c480840-bc1a-4dbd-ad03-2b67826e94e3 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:49 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:28:49 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:49 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:49 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5c480840-bc1a-4dbd-ad03-2b67826e94e3 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.314s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:49 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-5c480840-bc1a-4dbd-ad03-2b67826e94e3 tempest-ProjectReaderTests-498698692 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:28:49 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5c480840-bc1a-4dbd-ad03-2b67826e94e3 tempest-ProjectReaderTests-498698692 None] Deleted volume successfully. Sep 23 15:28:49 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-5c480840-bc1a-4dbd-ad03-2b67826e94e3 tempest-ProjectReaderTests-498698692 None] Lock "cinder-abd8d790-231f-42db-967c-cda3100e98c2-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3930fc04-6f18-4cf6-8da6-d3c25a4b9572 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3930fc04-6f18-4cf6-8da6-d3c25a4b9572 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:50 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-3930fc04-6f18-4cf6-8da6-d3c25a4b9572 tempest-ProjectMemberTests-607392192 None] Creating offline snapshot 247023df-3b89-4cb7-8062-0d69daa65ead of volume fabebd06-4b3e-470a-a81a-8ec110746fd6 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:28:50 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8157b39e-6ecf-497a-bde3-381a4f67bcd4]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3930fc04-6f18-4cf6-8da6-d3c25a4b9572 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:50 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6 Sep 23 15:28:50 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:50 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:28:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Flow 'volume_create_manager' (c4ac456c-daf5-4c1a-9ec9-3eca72c1101e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d790265-e7ea-4d91-a8c1-34684b28d4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d790265-e7ea-4d91-a8c1-34684b28d4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-23689567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fde52c53113485f85c9f1f77a36927e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:50Z,use_quota=True,user_id='90a09068610840cfbdf2be72dd01f471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5eb44f0-fe5a-47c4-ac40-d60046b6da09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5eb44f0-fe5a-47c4-ac40-d60046b6da09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ac42fc-ce67-4141-b411-4f83b67e3dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ac42fc-ce67-4141-b411-4f83b67e3dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002', 'volume_name': 'volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf80fb59-4b48-4731-94ba-76a64f053232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf80fb59-4b48-4731-94ba-76a64f053232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:50 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc368797-7230-4cf1-a733-11ad941daf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:50 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Volume 212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002', 'volume_size': 1} Sep 23 15:28:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:50 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3930fc04-6f18-4cf6-8da6-d3c25a4b9572 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6" returned: 0 in 0.420s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3930fc04-6f18-4cf6-8da6-d3c25a4b9572 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.247023df-3b89-4cb7-8062-0d69daa65ead 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:50 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.247023df-3b89-4cb7-8062-0d69daa65ead 1G Sep 23 15:28:50 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:50 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3930fc04-6f18-4cf6-8da6-d3c25a4b9572 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.247023df-3b89-4cb7-8062-0d69daa65ead 1G" returned: 0 in 0.444s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:50 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3930fc04-6f18-4cf6-8da6-d3c25a4b9572 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fabebd06-4b3e-470a-a81a-8ec110746fd6 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.247023df-3b89-4cb7-8062-0d69daa65ead {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:50 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fabebd06-4b3e-470a-a81a-8ec110746fd6 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.247023df-3b89-4cb7-8062-0d69daa65ead Sep 23 15:28:50 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:51 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3930fc04-6f18-4cf6-8da6-d3c25a4b9572 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fabebd06-4b3e-470a-a81a-8ec110746fd6 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.247023df-3b89-4cb7-8062-0d69daa65ead" returned: 0 in 0.339s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:51 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-3930fc04-6f18-4cf6-8da6-d3c25a4b9572 tempest-ProjectMemberTests-607392192 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.247023df-3b89-4cb7-8062-0d69daa65ead is being set with open permissions: ugo+rw Sep 23 15:28:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3930fc04-6f18-4cf6-8da6-d3c25a4b9572 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.247023df-3b89-4cb7-8062-0d69daa65ead {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:51 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.247023df-3b89-4cb7-8062-0d69daa65ead Sep 23 15:28:51 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:51 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3930fc04-6f18-4cf6-8da6-d3c25a4b9572 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.247023df-3b89-4cb7-8062-0d69daa65ead" returned: 0 in 0.251s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3930fc04-6f18-4cf6-8da6-d3c25a4b9572 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:51 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.info Sep 23 15:28:51 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:51 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3930fc04-6f18-4cf6-8da6-d3c25a4b9572 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.info" returned: 0 in 0.270s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:51 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-3930fc04-6f18-4cf6-8da6-d3c25a4b9572 tempest-ProjectMemberTests-607392192 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.info is being set with open permissions: ugo+rw Sep 23 15:28:51 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3930fc04-6f18-4cf6-8da6-d3c25a4b9572 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:51 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.info Sep 23 15:28:51 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:52 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3930fc04-6f18-4cf6-8da6-d3c25a4b9572 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.info" returned: 0 in 0.245s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3930fc04-6f18-4cf6-8da6-d3c25a4b9572 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.072s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.668s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-23689567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fde52c53113485f85c9f1f77a36927e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:50Z,use_quota=True,user_id='90a09068610840cfbdf2be72dd01f471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:28:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Creating volume 212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:28:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:28:52 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:28:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:52 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002 1073741824 Sep 23 15:28:52 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:52 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-3930fc04-6f18-4cf6-8da6-d3c25a4b9572 tempest-ProjectMemberTests-607392192 None] Create snapshot completed successfully Sep 23 15:28:52 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002 1073741824" returned: 0 in 0.437s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:52 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002 Sep 23 15:28:52 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:52 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002" returned: 0 in 0.268s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:52 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:28:52 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc368797-7230-4cf1-a733-11ad941daf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b44200-ddd7-4bfa-bc32-cf802da6d5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:52 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Volume volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002 (212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002): created successfully Sep 23 15:28:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b44200-ddd7-4bfa-bc32-cf802da6d5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:52 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Flow 'volume_create_manager' (c4ac456c-daf5-4c1a-9ec9-3eca72c1101e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:52 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7507c7e2-bf81-433a-948c-ba0235fa5bf6 tempest-ProjectReaderTests-498698692 None] Created volume successfully. Sep 23 15:28:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9a76e0ed-5f39-4faf-bf1b-84bb32abcdc7 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-247023df-3b89-4cb7-8062-0d69daa65ead-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9a76e0ed-5f39-4faf-bf1b-84bb32abcdc7 tempest-ProjectMemberTests-607392192 None] Lock "cinder-247023df-3b89-4cb7-8062-0d69daa65ead-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9a76e0ed-5f39-4faf-bf1b-84bb32abcdc7 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-fabebd06-4b3e-470a-a81a-8ec110746fd6" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9a76e0ed-5f39-4faf-bf1b-84bb32abcdc7 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-fabebd06-4b3e-470a-a81a-8ec110746fd6" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9a76e0ed-5f39-4faf-bf1b-84bb32abcdc7 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-247023df-3b89-4cb7-8062-0d69daa65ead" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:53 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9a76e0ed-5f39-4faf-bf1b-84bb32abcdc7 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-247023df-3b89-4cb7-8062-0d69daa65ead" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:53 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-9a76e0ed-5f39-4faf-bf1b-84bb32abcdc7 tempest-ProjectMemberTests-607392192 None] Deleting offline snapshot 247023df-3b89-4cb7-8062-0d69daa65ead of volume fabebd06-4b3e-470a-a81a-8ec110746fd6 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:28:53 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-9a76e0ed-5f39-4faf-bf1b-84bb32abcdc7 tempest-ProjectMemberTests-607392192 None] snapshot_file for this snap is: volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.247023df-3b89-4cb7-8062-0d69daa65ead {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:28:53 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca82839-460d-4f3a-a90f-dc09ef390b6f]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9a76e0ed-5f39-4faf-bf1b-84bb32abcdc7 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.247023df-3b89-4cb7-8062-0d69daa65ead {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:53 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.247023df-3b89-4cb7-8062-0d69daa65ead Sep 23 15:28:53 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ec55c044-63c3-418d-b637-ea0835d900b2 tempest-ProjectReaderTests-498698692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ec55c044-63c3-418d-b637-ea0835d900b2 tempest-ProjectReaderTests-498698692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:53 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-ec55c044-63c3-418d-b637-ea0835d900b2 tempest-ProjectReaderTests-498698692 None] Creating offline snapshot 257d87fb-548f-4b74-9e6c-fa9924bca88a of volume 212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:28:53 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f94588-ec31-4775-806e-50e49cc9c442]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ec55c044-63c3-418d-b637-ea0835d900b2 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:53 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9a76e0ed-5f39-4faf-bf1b-84bb32abcdc7 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.247023df-3b89-4cb7-8062-0d69daa65ead" returned: 0 in 0.431s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:53 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-9a76e0ed-5f39-4faf-bf1b-84bb32abcdc7 tempest-ProjectMemberTests-607392192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fabebd06-4b3e-470a-a81a-8ec110746fd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:28:53 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[54031978-9e1f-421c-a3b5-a15dae7a2714]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:53 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9a76e0ed-5f39-4faf-bf1b-84bb32abcdc7 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:53 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002 Sep 23 15:28:53 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:53 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6 Sep 23 15:28:53 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:54 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ec55c044-63c3-418d-b637-ea0835d900b2 tempest-ProjectReaderTests-498698692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002" returned: 0 in 0.427s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ec55c044-63c3-418d-b637-ea0835d900b2 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.257d87fb-548f-4b74-9e6c-fa9924bca88a 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:54 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.257d87fb-548f-4b74-9e6c-fa9924bca88a 1G Sep 23 15:28:54 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:54 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9a76e0ed-5f39-4faf-bf1b-84bb32abcdc7 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6" returned: 0 in 0.459s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9a76e0ed-5f39-4faf-bf1b-84bb32abcdc7 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.247023df-3b89-4cb7-8062-0d69daa65ead {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:54 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.247023df-3b89-4cb7-8062-0d69daa65ead Sep 23 15:28:54 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:54 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ec55c044-63c3-418d-b637-ea0835d900b2 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.257d87fb-548f-4b74-9e6c-fa9924bca88a 1G" returned: 0 in 0.524s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ec55c044-63c3-418d-b637-ea0835d900b2 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.257d87fb-548f-4b74-9e6c-fa9924bca88a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:54 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.257d87fb-548f-4b74-9e6c-fa9924bca88a Sep 23 15:28:54 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:54 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9a76e0ed-5f39-4faf-bf1b-84bb32abcdc7 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.247023df-3b89-4cb7-8062-0d69daa65ead" returned: 0 in 0.420s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:54 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9a76e0ed-5f39-4faf-bf1b-84bb32abcdc7 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.247023df-3b89-4cb7-8062-0d69daa65ead {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:54 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.247023df-3b89-4cb7-8062-0d69daa65ead Sep 23 15:28:54 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:55 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9a76e0ed-5f39-4faf-bf1b-84bb32abcdc7 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6.247023df-3b89-4cb7-8062-0d69daa65ead" returned: 0 in 0.269s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:55 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ec55c044-63c3-418d-b637-ea0835d900b2 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.257d87fb-548f-4b74-9e6c-fa9924bca88a" returned: 0 in 0.349s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:55 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-ec55c044-63c3-418d-b637-ea0835d900b2 tempest-ProjectReaderTests-498698692 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.257d87fb-548f-4b74-9e6c-fa9924bca88a is being set with open permissions: ugo+rw Sep 23 15:28:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ec55c044-63c3-418d-b637-ea0835d900b2 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.257d87fb-548f-4b74-9e6c-fa9924bca88a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:55 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9a76e0ed-5f39-4faf-bf1b-84bb32abcdc7 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-247023df-3b89-4cb7-8062-0d69daa65ead" released by "_delete_snapshot" :: held 1.740s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:55 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9a76e0ed-5f39-4faf-bf1b-84bb32abcdc7 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-fabebd06-4b3e-470a-a81a-8ec110746fd6" released by "delete_snapshot" :: held 1.791s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:55 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.257d87fb-548f-4b74-9e6c-fa9924bca88a Sep 23 15:28:55 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:55 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-9a76e0ed-5f39-4faf-bf1b-84bb32abcdc7 tempest-ProjectMemberTests-607392192 None] Created reservations ['751bd352-7a2b-41ea-b06b-1d8e07b15f3a', '5655450d-a741-4d8a-aba5-1b46a84aeafe', 'a7f546ec-b755-43bd-971e-bcdd849d28f2', 'f83ee66d-3e29-4277-bacc-bb4703a0dd6d'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:55 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-9a76e0ed-5f39-4faf-bf1b-84bb32abcdc7 tempest-ProjectMemberTests-607392192 None] Delete snapshot completed successfully. Sep 23 15:28:55 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-9a76e0ed-5f39-4faf-bf1b-84bb32abcdc7 tempest-ProjectMemberTests-607392192 None] Lock "cinder-247023df-3b89-4cb7-8062-0d69daa65ead-delete_snapshot" released by "delete_snapshot" :: held 1.977s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:55 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ec55c044-63c3-418d-b637-ea0835d900b2 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.257d87fb-548f-4b74-9e6c-fa9924bca88a" returned: 0 in 0.296s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ec55c044-63c3-418d-b637-ea0835d900b2 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:55 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.info Sep 23 15:28:55 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:55 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-34bea941-cd38-4ab4-8577-aad7663b70dd tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-fabebd06-4b3e-470a-a81a-8ec110746fd6-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:55 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-34bea941-cd38-4ab4-8577-aad7663b70dd tempest-ProjectMemberTests-607392192 None] Lock "cinder-fabebd06-4b3e-470a-a81a-8ec110746fd6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:55 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-34bea941-cd38-4ab4-8577-aad7663b70dd tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-fabebd06-4b3e-470a-a81a-8ec110746fd6" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:55 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-34bea941-cd38-4ab4-8577-aad7663b70dd tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-fabebd06-4b3e-470a-a81a-8ec110746fd6" acquired by "delete_volume" :: waited 0.029s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:55 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c80851-acb7-410f-8d96-c4881e861680]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-34bea941-cd38-4ab4-8577-aad7663b70dd tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:55 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ec55c044-63c3-418d-b637-ea0835d900b2 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.info" returned: 0 in 0.337s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:55 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6 Sep 23 15:28:55 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-ec55c044-63c3-418d-b637-ea0835d900b2 tempest-ProjectReaderTests-498698692 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.info is being set with open permissions: ugo+rw Sep 23 15:28:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ec55c044-63c3-418d-b637-ea0835d900b2 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:55 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:55 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.info Sep 23 15:28:55 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:55 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:55 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ec55c044-63c3-418d-b637-ea0835d900b2 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.info" returned: 0 in 0.281s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:56 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-ec55c044-63c3-418d-b637-ea0835d900b2 tempest-ProjectReaderTests-498698692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.322s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-34bea941-cd38-4ab4-8577-aad7663b70dd tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6" returned: 0 in 0.430s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-34bea941-cd38-4ab4-8577-aad7663b70dd tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:56 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6 Sep 23 15:28:56 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:56 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-ec55c044-63c3-418d-b637-ea0835d900b2 tempest-ProjectReaderTests-498698692 None] Create snapshot completed successfully Sep 23 15:28:56 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-34bea941-cd38-4ab4-8577-aad7663b70dd tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-fabebd06-4b3e-470a-a81a-8ec110746fd6" returned: 0 in 0.268s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-34bea941-cd38-4ab4-8577-aad7663b70dd tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-fabebd06-4b3e-470a-a81a-8ec110746fd6" released by "delete_volume" :: held 0.773s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-34bea941-cd38-4ab4-8577-aad7663b70dd tempest-ProjectMemberTests-607392192 None] Created reservations ['b5f22ab8-ad66-4da3-ac75-77d425b1e121', '0cfe900d-b1ed-4f81-95b5-8077d755af4c', '30de4632-7ec4-4027-ac7c-bf2ab4f7c0f7', '3c1f13d8-9677-4060-9a4a-e6938513ace5'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-34bea941-cd38-4ab4-8577-aad7663b70dd tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-34bea941-cd38-4ab4-8577-aad7663b70dd tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-34bea941-cd38-4ab4-8577-aad7663b70dd tempest-ProjectMemberTests-607392192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-34bea941-cd38-4ab4-8577-aad7663b70dd tempest-ProjectMemberTests-607392192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-34bea941-cd38-4ab4-8577-aad7663b70dd tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-34bea941-cd38-4ab4-8577-aad7663b70dd tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:56 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:28:56 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:56 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-34bea941-cd38-4ab4-8577-aad7663b70dd tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.254s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-34bea941-cd38-4ab4-8577-aad7663b70dd tempest-ProjectMemberTests-607392192 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:28:56 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-34bea941-cd38-4ab4-8577-aad7663b70dd tempest-ProjectMemberTests-607392192 None] Deleted volume successfully. Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-34bea941-cd38-4ab4-8577-aad7663b70dd tempest-ProjectMemberTests-607392192 None] Lock "cinder-fabebd06-4b3e-470a-a81a-8ec110746fd6-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-901506b2-527e-426e-a039-ab187abff6a2 tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-257d87fb-548f-4b74-9e6c-fa9924bca88a-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-901506b2-527e-426e-a039-ab187abff6a2 tempest-ProjectReaderTests-498698692 None] Lock "cinder-257d87fb-548f-4b74-9e6c-fa9924bca88a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-901506b2-527e-426e-a039-ab187abff6a2 tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-quobyte-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-901506b2-527e-426e-a039-ab187abff6a2 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-901506b2-527e-426e-a039-ab187abff6a2 tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-quobyte-257d87fb-548f-4b74-9e6c-fa9924bca88a" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-901506b2-527e-426e-a039-ab187abff6a2 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-257d87fb-548f-4b74-9e6c-fa9924bca88a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-901506b2-527e-426e-a039-ab187abff6a2 tempest-ProjectReaderTests-498698692 None] Deleting offline snapshot 257d87fb-548f-4b74-9e6c-fa9924bca88a of volume 212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-901506b2-527e-426e-a039-ab187abff6a2 tempest-ProjectReaderTests-498698692 None] snapshot_file for this snap is: volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.257d87fb-548f-4b74-9e6c-fa9924bca88a {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fcae72-ed88-407b-a045-5cf40fc60ebc]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:56 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-901506b2-527e-426e-a039-ab187abff6a2 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.257d87fb-548f-4b74-9e6c-fa9924bca88a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Flow 'volume_create_manager' (91b6e891-4e91-4f50-bcf9-5c707487a7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:57 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.257d87fb-548f-4b74-9e6c-fa9924bca88a Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91079293-973b-448a-8a58-0ebc030b4b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:57 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91079293-973b-448a-8a58-0ebc030b4b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-254047226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f9e0dab-ef9f-4a6a-948e-a80aae3216b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66989f39c71404c9b228b7946437c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:57Z,use_quota=True,user_id='1a89078dd833490e8539b9c452c2a583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865c3631-a6fe-4306-a2d1-d4c58fa487c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865c3631-a6fe-4306-a2d1-d4c58fa487c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9aa2ed-83bf-4ca2-8bea-43334f501fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9aa2ed-83bf-4ca2-8bea-43334f501fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f9e0dab-ef9f-4a6a-948e-a80aae3216b8', 'volume_name': 'volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (247ebd96-83ec-476d-994d-2a5b4126aa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (247ebd96-83ec-476d-994d-2a5b4126aa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f985bdb-85ec-4b54-9bb5-3a2484158ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:57 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Volume 8f9e0dab-ef9f-4a6a-948e-a80aae3216b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8', 'volume_size': 1} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-254047226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f9e0dab-ef9f-4a6a-948e-a80aae3216b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66989f39c71404c9b228b7946437c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:28:57Z,use_quota=True,user_id='1a89078dd833490e8539b9c452c2a583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Creating volume 8f9e0dab-ef9f-4a6a-948e-a80aae3216b8 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:28:57 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:57 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8 1073741824 Sep 23 15:28:57 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:57 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-901506b2-527e-426e-a039-ab187abff6a2 tempest-ProjectReaderTests-498698692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.257d87fb-548f-4b74-9e6c-fa9924bca88a" returned: 0 in 0.383s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-901506b2-527e-426e-a039-ab187abff6a2 tempest-ProjectReaderTests-498698692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca3bc7b-733e-48ce-a026-f7db0df4f4c4]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-901506b2-527e-426e-a039-ab187abff6a2 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:57 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002 Sep 23 15:28:57 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:57 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8 1073741824" returned: 0 in 0.473s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:57 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8 Sep 23 15:28:57 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:57 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-901506b2-527e-426e-a039-ab187abff6a2 tempest-ProjectReaderTests-498698692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002" returned: 0 in 0.407s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-901506b2-527e-426e-a039-ab187abff6a2 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.257d87fb-548f-4b74-9e6c-fa9924bca88a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:57 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.257d87fb-548f-4b74-9e6c-fa9924bca88a Sep 23 15:28:57 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:57 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8" returned: 0 in 0.272s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f985bdb-85ec-4b54-9bb5-3a2484158ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac91f95d-5e21-4aad-926b-80f5753d400e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:28:57 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Volume volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8 (8f9e0dab-ef9f-4a6a-948e-a80aae3216b8): created successfully Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac91f95d-5e21-4aad-926b-80f5753d400e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:28:57 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Flow 'volume_create_manager' (91b6e891-4e91-4f50-bcf9-5c707487a7ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:28:58 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-0dc821c5-3dd6-4482-8f7c-4f3321eaf1e8 tempest-ProjectMemberTests-607392192 None] Created volume successfully. Sep 23 15:28:58 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-901506b2-527e-426e-a039-ab187abff6a2 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.257d87fb-548f-4b74-9e6c-fa9924bca88a" returned: 0 in 0.348s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-901506b2-527e-426e-a039-ab187abff6a2 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.257d87fb-548f-4b74-9e6c-fa9924bca88a {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:58 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.257d87fb-548f-4b74-9e6c-fa9924bca88a Sep 23 15:28:58 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:58 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:58 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-901506b2-527e-426e-a039-ab187abff6a2 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002.257d87fb-548f-4b74-9e6c-fa9924bca88a" returned: 0 in 0.250s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-901506b2-527e-426e-a039-ab187abff6a2 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-257d87fb-548f-4b74-9e6c-fa9924bca88a" released by "_delete_snapshot" :: held 1.493s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-901506b2-527e-426e-a039-ab187abff6a2 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002" released by "delete_snapshot" :: held 1.519s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:58 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-901506b2-527e-426e-a039-ab187abff6a2 tempest-ProjectReaderTests-498698692 None] Created reservations ['0700e706-5ebd-4e82-8abf-0a3d6bbe5c70', '44f66e69-d1e6-492d-b80e-2aa24849059c', 'eb63da0a-8e8a-43cd-999f-c51e9d4c3b44', 'fb8df9ec-b47e-4ab9-a19e-84d78ed8f601'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:58 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-901506b2-527e-426e-a039-ab187abff6a2 tempest-ProjectReaderTests-498698692 None] Delete snapshot completed successfully. Sep 23 15:28:58 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-901506b2-527e-426e-a039-ab187abff6a2 tempest-ProjectReaderTests-498698692 None] Lock "cinder-257d87fb-548f-4b74-9e6c-fa9924bca88a-delete_snapshot" released by "delete_snapshot" :: held 1.649s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4e778fb5-ad49-4232-b989-e093fbecf508 tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4e778fb5-ad49-4232-b989-e093fbecf508 tempest-ProjectReaderTests-498698692 None] Lock "cinder-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4e778fb5-ad49-4232-b989-e093fbecf508 tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-quobyte-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4e778fb5-ad49-4232-b989-e093fbecf508 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002" acquired by "delete_volume" :: waited 0.014s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c11dced-afb6-415b-b62b-26d42df6cbd1]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4e778fb5-ad49-4232-b989-e093fbecf508 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:59 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002 Sep 23 15:28:59 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e8234fe9-53bd-4480-9d27-7ffabfc76550 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e8234fe9-53bd-4480-9d27-7ffabfc76550 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-e8234fe9-53bd-4480-9d27-7ffabfc76550 tempest-ProjectMemberTests-607392192 None] Creating offline snapshot 7a013ffb-6a76-47a5-bd9d-4b2f15201858 of volume 8f9e0dab-ef9f-4a6a-948e-a80aae3216b8 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[99898d60-7a58-4d3a-8420-580bd6c71af2]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e8234fe9-53bd-4480-9d27-7ffabfc76550 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:59 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8 Sep 23 15:28:59 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:59 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4e778fb5-ad49-4232-b989-e093fbecf508 tempest-ProjectReaderTests-498698692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002" returned: 0 in 0.390s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4e778fb5-ad49-4232-b989-e093fbecf508 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:59 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002 Sep 23 15:28:59 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:59 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e8234fe9-53bd-4480-9d27-7ffabfc76550 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8" returned: 0 in 0.401s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e8234fe9-53bd-4480-9d27-7ffabfc76550 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.7a013ffb-6a76-47a5-bd9d-4b2f15201858 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:59 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.7a013ffb-6a76-47a5-bd9d-4b2f15201858 1G Sep 23 15:28:59 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:28:59 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4e778fb5-ad49-4232-b989-e093fbecf508 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002" returned: 0 in 0.281s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4e778fb5-ad49-4232-b989-e093fbecf508 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002" released by "delete_volume" :: held 0.747s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-4e778fb5-ad49-4232-b989-e093fbecf508 tempest-ProjectReaderTests-498698692 None] Created reservations ['616c02a0-a154-4f80-a6da-646cc67c1f68', '832cbd97-eae8-4085-8d47-9b00e17e6cb7', '5d8ed21f-1585-4f28-a0e2-648077e8ac87', 'a9356704-4e3f-4019-9bbd-0c7e89695d57'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4e778fb5-ad49-4232-b989-e093fbecf508 tempest-ProjectReaderTests-498698692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4e778fb5-ad49-4232-b989-e093fbecf508 tempest-ProjectReaderTests-498698692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4e778fb5-ad49-4232-b989-e093fbecf508 tempest-ProjectReaderTests-498698692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-4e778fb5-ad49-4232-b989-e093fbecf508 tempest-ProjectReaderTests-498698692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-4e778fb5-ad49-4232-b989-e093fbecf508 tempest-ProjectReaderTests-498698692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:28:59 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4e778fb5-ad49-4232-b989-e093fbecf508 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:28:59 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:28:59 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:00 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e8234fe9-53bd-4480-9d27-7ffabfc76550 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.7a013ffb-6a76-47a5-bd9d-4b2f15201858 1G" returned: 0 in 0.440s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e8234fe9-53bd-4480-9d27-7ffabfc76550 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.7a013ffb-6a76-47a5-bd9d-4b2f15201858 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:00 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.7a013ffb-6a76-47a5-bd9d-4b2f15201858 Sep 23 15:29:00 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:00 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-4e778fb5-ad49-4232-b989-e093fbecf508 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.292s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:00 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-4e778fb5-ad49-4232-b989-e093fbecf508 tempest-ProjectReaderTests-498698692 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:29:00 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-4e778fb5-ad49-4232-b989-e093fbecf508 tempest-ProjectReaderTests-498698692 None] Deleted volume successfully. Sep 23 15:29:00 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-4e778fb5-ad49-4232-b989-e093fbecf508 tempest-ProjectReaderTests-498698692 None] Lock "cinder-212d2cc3-8a6f-4fd2-95b8-fbfcd27cb002-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:00 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e8234fe9-53bd-4480-9d27-7ffabfc76550 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.7a013ffb-6a76-47a5-bd9d-4b2f15201858" returned: 0 in 0.354s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:00 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-e8234fe9-53bd-4480-9d27-7ffabfc76550 tempest-ProjectMemberTests-607392192 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.7a013ffb-6a76-47a5-bd9d-4b2f15201858 is being set with open permissions: ugo+rw Sep 23 15:29:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e8234fe9-53bd-4480-9d27-7ffabfc76550 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.7a013ffb-6a76-47a5-bd9d-4b2f15201858 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:00 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.7a013ffb-6a76-47a5-bd9d-4b2f15201858 Sep 23 15:29:00 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:00 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:29:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Flow 'volume_create_manager' (07e4ca84-ed92-4faf-8b61-f11a10cc4c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:29:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ea4182-9aba-4a91-ab8d-3f5896dc013f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ea4182-9aba-4a91-ab8d-3f5896dc013f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1274629106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f1a36b-be8b-44df-8725-082d34e050c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fde52c53113485f85c9f1f77a36927e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:29:01Z,use_quota=True,user_id='90a09068610840cfbdf2be72dd01f471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8caef694-db53-4be7-be32-4abbfab78f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8caef694-db53-4be7-be32-4abbfab78f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed236a8-2a99-42bd-ba5a-3acdd8b77ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed236a8-2a99-42bd-ba5a-3acdd8b77ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70f1a36b-be8b-44df-8725-082d34e050c2', 'volume_name': 'volume-70f1a36b-be8b-44df-8725-082d34e050c2', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be97ff47-dcb1-43f4-90b6-94092e049a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be97ff47-dcb1-43f4-90b6-94092e049a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:00 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d045e345-c1c2-410b-aa64-a3f6c70cd076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:00 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Volume 70f1a36b-be8b-44df-8725-082d34e050c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70f1a36b-be8b-44df-8725-082d34e050c2', 'volume_size': 1} Sep 23 15:29:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:00 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e8234fe9-53bd-4480-9d27-7ffabfc76550 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.7a013ffb-6a76-47a5-bd9d-4b2f15201858" returned: 0 in 0.253s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:00 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e8234fe9-53bd-4480-9d27-7ffabfc76550 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:00 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.info Sep 23 15:29:00 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:01 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e8234fe9-53bd-4480-9d27-7ffabfc76550 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.info" returned: 0 in 0.249s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:01 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-e8234fe9-53bd-4480-9d27-7ffabfc76550 tempest-ProjectMemberTests-607392192 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.info is being set with open permissions: ugo+rw Sep 23 15:29:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e8234fe9-53bd-4480-9d27-7ffabfc76550 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:01 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.info Sep 23 15:29:01 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:01 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-e8234fe9-53bd-4480-9d27-7ffabfc76550 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.info" returned: 0 in 0.249s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-e8234fe9-53bd-4480-9d27-7ffabfc76550 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.028s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.595s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1274629106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f1a36b-be8b-44df-8725-082d34e050c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fde52c53113485f85c9f1f77a36927e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:29:01Z,use_quota=True,user_id='90a09068610840cfbdf2be72dd01f471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:29:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Creating volume 70f1a36b-be8b-44df-8725-082d34e050c2 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:29:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:29:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:29:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:01 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:29:01 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:29:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:01 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:UPDATE=233,cinder:SELECT=161,cinder:INSERT=63,cinder:DELETE=21 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:29:01 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2 1073741824 Sep 23 15:29:01 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:01 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-e8234fe9-53bd-4480-9d27-7ffabfc76550 tempest-ProjectMemberTests-607392192 None] Create snapshot completed successfully Sep 23 15:29:01 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:UPDATE=221,cinder:SELECT=193,cinder:INSERT=57,cinder:DELETE=18 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:29:01 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2 1073741824" returned: 0 in 0.439s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:01 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:01 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2 Sep 23 15:29:01 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:02 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2" returned: 0 in 0.248s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d045e345-c1c2-410b-aa64-a3f6c70cd076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70f1a36b-be8b-44df-8725-082d34e050c2', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf3a618-e1ed-4934-bc59-8f4032722b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:02 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Volume volume-70f1a36b-be8b-44df-8725-082d34e050c2 (70f1a36b-be8b-44df-8725-082d34e050c2): created successfully Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf3a618-e1ed-4934-bc59-8f4032722b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Flow 'volume_create_manager' (07e4ca84-ed92-4faf-8b61-f11a10cc4c45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:29:02 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-713b005b-2568-4949-8667-6f7060cd68ff tempest-ProjectReaderTests-498698692 None] Created volume successfully. Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-438a5344-94c9-4a8c-bdd4-72dd9c94d245 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-7a013ffb-6a76-47a5-bd9d-4b2f15201858-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-438a5344-94c9-4a8c-bdd4-72dd9c94d245 tempest-ProjectMemberTests-607392192 None] Lock "cinder-7a013ffb-6a76-47a5-bd9d-4b2f15201858-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-438a5344-94c9-4a8c-bdd4-72dd9c94d245 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-438a5344-94c9-4a8c-bdd4-72dd9c94d245 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-438a5344-94c9-4a8c-bdd4-72dd9c94d245 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-7a013ffb-6a76-47a5-bd9d-4b2f15201858" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-438a5344-94c9-4a8c-bdd4-72dd9c94d245 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-7a013ffb-6a76-47a5-bd9d-4b2f15201858" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-438a5344-94c9-4a8c-bdd4-72dd9c94d245 tempest-ProjectMemberTests-607392192 None] Deleting offline snapshot 7a013ffb-6a76-47a5-bd9d-4b2f15201858 of volume 8f9e0dab-ef9f-4a6a-948e-a80aae3216b8 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-438a5344-94c9-4a8c-bdd4-72dd9c94d245 tempest-ProjectMemberTests-607392192 None] snapshot_file for this snap is: volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.7a013ffb-6a76-47a5-bd9d-4b2f15201858 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[c331f73d-bb07-4a10-a4ec-e996dad8f112]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-438a5344-94c9-4a8c-bdd4-72dd9c94d245 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.7a013ffb-6a76-47a5-bd9d-4b2f15201858 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:02 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.7a013ffb-6a76-47a5-bd9d-4b2f15201858 Sep 23 15:29:02 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5d436968-56e9-4458-bc68-a5d50db1113f tempest-ProjectReaderTests-498698692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5d436968-56e9-4458-bc68-a5d50db1113f tempest-ProjectReaderTests-498698692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-5d436968-56e9-4458-bc68-a5d50db1113f tempest-ProjectReaderTests-498698692 None] Creating offline snapshot 1b6f0219-2bbb-4484-8dda-ff666ed9a27b of volume 70f1a36b-be8b-44df-8725-082d34e050c2 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dfe365-742b-44bb-9cfe-4c8e1d4e3387]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5d436968-56e9-4458-bc68-a5d50db1113f tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:02 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-438a5344-94c9-4a8c-bdd4-72dd9c94d245 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.7a013ffb-6a76-47a5-bd9d-4b2f15201858" returned: 0 in 0.393s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:02 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-438a5344-94c9-4a8c-bdd4-72dd9c94d245 tempest-ProjectMemberTests-607392192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:29:03 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[8accf971-2dae-4b20-8501-bc15d8e318ae]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-438a5344-94c9-4a8c-bdd4-72dd9c94d245 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:03 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2 Sep 23 15:29:03 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:03 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8 Sep 23 15:29:03 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:03 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5d436968-56e9-4458-bc68-a5d50db1113f tempest-ProjectReaderTests-498698692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2" returned: 0 in 0.391s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5d436968-56e9-4458-bc68-a5d50db1113f tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.1b6f0219-2bbb-4484-8dda-ff666ed9a27b 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:03 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.1b6f0219-2bbb-4484-8dda-ff666ed9a27b 1G Sep 23 15:29:03 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:03 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-438a5344-94c9-4a8c-bdd4-72dd9c94d245 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8" returned: 0 in 0.407s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-438a5344-94c9-4a8c-bdd4-72dd9c94d245 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.7a013ffb-6a76-47a5-bd9d-4b2f15201858 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:03 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.7a013ffb-6a76-47a5-bd9d-4b2f15201858 Sep 23 15:29:03 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:03 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-438a5344-94c9-4a8c-bdd4-72dd9c94d245 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.7a013ffb-6a76-47a5-bd9d-4b2f15201858" returned: 0 in 0.349s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-438a5344-94c9-4a8c-bdd4-72dd9c94d245 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.7a013ffb-6a76-47a5-bd9d-4b2f15201858 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:03 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5d436968-56e9-4458-bc68-a5d50db1113f tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.1b6f0219-2bbb-4484-8dda-ff666ed9a27b 1G" returned: 0 in 0.444s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:03 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5d436968-56e9-4458-bc68-a5d50db1113f tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70f1a36b-be8b-44df-8725-082d34e050c2 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.1b6f0219-2bbb-4484-8dda-ff666ed9a27b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:03 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.7a013ffb-6a76-47a5-bd9d-4b2f15201858 Sep 23 15:29:03 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:03 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70f1a36b-be8b-44df-8725-082d34e050c2 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.1b6f0219-2bbb-4484-8dda-ff666ed9a27b Sep 23 15:29:03 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:04 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-438a5344-94c9-4a8c-bdd4-72dd9c94d245 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8.7a013ffb-6a76-47a5-bd9d-4b2f15201858" returned: 0 in 0.261s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-438a5344-94c9-4a8c-bdd4-72dd9c94d245 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-7a013ffb-6a76-47a5-bd9d-4b2f15201858" released by "_delete_snapshot" :: held 1.520s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-438a5344-94c9-4a8c-bdd4-72dd9c94d245 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8" released by "delete_snapshot" :: held 1.546s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:04 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5d436968-56e9-4458-bc68-a5d50db1113f tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70f1a36b-be8b-44df-8725-082d34e050c2 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.1b6f0219-2bbb-4484-8dda-ff666ed9a27b" returned: 0 in 0.321s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:04 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-5d436968-56e9-4458-bc68-a5d50db1113f tempest-ProjectReaderTests-498698692 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.1b6f0219-2bbb-4484-8dda-ff666ed9a27b is being set with open permissions: ugo+rw Sep 23 15:29:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5d436968-56e9-4458-bc68-a5d50db1113f tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.1b6f0219-2bbb-4484-8dda-ff666ed9a27b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:04 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.1b6f0219-2bbb-4484-8dda-ff666ed9a27b Sep 23 15:29:04 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:04 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-438a5344-94c9-4a8c-bdd4-72dd9c94d245 tempest-ProjectMemberTests-607392192 None] Created reservations ['73a0ac88-3226-4cc3-b158-5b3ae777fcd5', 'b6cbad76-ad32-4438-95ce-28a516f28862', 'c9fd117a-e2ff-4e4d-bea5-26619f0a5396', '7f9704b8-9b6a-4843-a9aa-f9b26eb6789e'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:29:04 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-438a5344-94c9-4a8c-bdd4-72dd9c94d245 tempest-ProjectMemberTests-607392192 None] Delete snapshot completed successfully. Sep 23 15:29:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-438a5344-94c9-4a8c-bdd4-72dd9c94d245 tempest-ProjectMemberTests-607392192 None] Lock "cinder-7a013ffb-6a76-47a5-bd9d-4b2f15201858-delete_snapshot" released by "delete_snapshot" :: held 1.727s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:04 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5d436968-56e9-4458-bc68-a5d50db1113f tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.1b6f0219-2bbb-4484-8dda-ff666ed9a27b" returned: 0 in 0.254s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5d436968-56e9-4458-bc68-a5d50db1113f tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:04 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.info Sep 23 15:29:04 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:04 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5d436968-56e9-4458-bc68-a5d50db1113f tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.info" returned: 0 in 0.262s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:04 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-5d436968-56e9-4458-bc68-a5d50db1113f tempest-ProjectReaderTests-498698692 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.info is being set with open permissions: ugo+rw Sep 23 15:29:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5d436968-56e9-4458-bc68-a5d50db1113f tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-532db7a0-718c-498b-a11b-5560e9dfc6fe tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:04 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.info Sep 23 15:29:04 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-532db7a0-718c-498b-a11b-5560e9dfc6fe tempest-ProjectMemberTests-607392192 None] Lock "cinder-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-532db7a0-718c-498b-a11b-5560e9dfc6fe tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:04 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-532db7a0-718c-498b-a11b-5560e9dfc6fe tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8" acquired by "delete_volume" :: waited 0.015s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:04 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a228a4-2847-440f-bead-618fb0a80ed5]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-532db7a0-718c-498b-a11b-5560e9dfc6fe tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:04 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8 Sep 23 15:29:04 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:04 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-5d436968-56e9-4458-bc68-a5d50db1113f tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.info" returned: 0 in 0.289s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:04 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-5d436968-56e9-4458-bc68-a5d50db1113f tempest-ProjectReaderTests-498698692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.060s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:04 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-5d436968-56e9-4458-bc68-a5d50db1113f tempest-ProjectReaderTests-498698692 None] Create snapshot completed successfully Sep 23 15:29:05 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-532db7a0-718c-498b-a11b-5560e9dfc6fe tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8" returned: 0 in 0.379s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-532db7a0-718c-498b-a11b-5560e9dfc6fe tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:05 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8 Sep 23 15:29:05 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:05 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-532db7a0-718c-498b-a11b-5560e9dfc6fe tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8" returned: 0 in 0.262s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:05 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-532db7a0-718c-498b-a11b-5560e9dfc6fe tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8" released by "delete_volume" :: held 0.708s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:05 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-532db7a0-718c-498b-a11b-5560e9dfc6fe tempest-ProjectMemberTests-607392192 None] Created reservations ['26d499d0-971b-4528-a938-d9fc3d4bf4d7', '7711707b-b3a6-45cd-aa9e-1ed4ec296433', 'd56267dd-75c6-4a1d-b7a2-0496f98b48e9', 'cf376ea7-0276-4d07-968a-7b64d9dd89db'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:29:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-532db7a0-718c-498b-a11b-5560e9dfc6fe tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-532db7a0-718c-498b-a11b-5560e9dfc6fe tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-532db7a0-718c-498b-a11b-5560e9dfc6fe tempest-ProjectMemberTests-607392192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:29:05 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-532db7a0-718c-498b-a11b-5560e9dfc6fe tempest-ProjectMemberTests-607392192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:29:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-532db7a0-718c-498b-a11b-5560e9dfc6fe tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-532db7a0-718c-498b-a11b-5560e9dfc6fe tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:05 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:29:05 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:05 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:05 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-532db7a0-718c-498b-a11b-5560e9dfc6fe tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.266s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:05 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-532db7a0-718c-498b-a11b-5560e9dfc6fe tempest-ProjectMemberTests-607392192 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:29:05 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-532db7a0-718c-498b-a11b-5560e9dfc6fe tempest-ProjectMemberTests-607392192 None] Deleted volume successfully. Sep 23 15:29:05 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-532db7a0-718c-498b-a11b-5560e9dfc6fe tempest-ProjectMemberTests-607392192 None] Lock "cinder-8f9e0dab-ef9f-4a6a-948e-a80aae3216b8-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-73a13af2-fdd7-42a3-a134-37080db91af6 tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-1b6f0219-2bbb-4484-8dda-ff666ed9a27b-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-73a13af2-fdd7-42a3-a134-37080db91af6 tempest-ProjectReaderTests-498698692 None] Lock "cinder-1b6f0219-2bbb-4484-8dda-ff666ed9a27b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-73a13af2-fdd7-42a3-a134-37080db91af6 tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-quobyte-70f1a36b-be8b-44df-8725-082d34e050c2" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-73a13af2-fdd7-42a3-a134-37080db91af6 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-70f1a36b-be8b-44df-8725-082d34e050c2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-73a13af2-fdd7-42a3-a134-37080db91af6 tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-quobyte-1b6f0219-2bbb-4484-8dda-ff666ed9a27b" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-73a13af2-fdd7-42a3-a134-37080db91af6 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-1b6f0219-2bbb-4484-8dda-ff666ed9a27b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-73a13af2-fdd7-42a3-a134-37080db91af6 tempest-ProjectReaderTests-498698692 None] Deleting offline snapshot 1b6f0219-2bbb-4484-8dda-ff666ed9a27b of volume 70f1a36b-be8b-44df-8725-082d34e050c2 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-73a13af2-fdd7-42a3-a134-37080db91af6 tempest-ProjectReaderTests-498698692 None] snapshot_file for this snap is: volume-70f1a36b-be8b-44df-8725-082d34e050c2.1b6f0219-2bbb-4484-8dda-ff666ed9a27b {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e60d04-6f2c-448c-bc01-19c4277423d7]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-73a13af2-fdd7-42a3-a134-37080db91af6 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.1b6f0219-2bbb-4484-8dda-ff666ed9a27b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Flow 'volume_create_manager' (21259656-4402-46bb-bf7a-d775bcf1bead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:29:06 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.1b6f0219-2bbb-4484-8dda-ff666ed9a27b Sep 23 15:29:06 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80acf631-70f6-41e8-8b45-bdaf6101a3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80acf631-70f6-41e8-8b45-bdaf6101a3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1941720759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a65004d-a5f6-48de-952a-10bb61b80594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66989f39c71404c9b228b7946437c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:29:06Z,use_quota=True,user_id='1a89078dd833490e8539b9c452c2a583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4b152a-ee39-43de-96eb-e9892ab2eba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4b152a-ee39-43de-96eb-e9892ab2eba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f153ba-dcab-46a9-a5d8-4d1dc57557f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f153ba-dcab-46a9-a5d8-4d1dc57557f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a65004d-a5f6-48de-952a-10bb61b80594', 'volume_name': 'volume-3a65004d-a5f6-48de-952a-10bb61b80594', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3fde747-835e-4af1-a368-24b254d5c5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3fde747-835e-4af1-a368-24b254d5c5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a806b2-7bea-4365-8631-ed9b95998823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:06 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Volume 3a65004d-a5f6-48de-952a-10bb61b80594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a65004d-a5f6-48de-952a-10bb61b80594', 'volume_size': 1} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1941720759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a65004d-a5f6-48de-952a-10bb61b80594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66989f39c71404c9b228b7946437c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:29:06Z,use_quota=True,user_id='1a89078dd833490e8539b9c452c2a583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Creating volume 3a65004d-a5f6-48de-952a-10bb61b80594 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:29:06 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:06 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594 1073741824 Sep 23 15:29:06 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:06 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-73a13af2-fdd7-42a3-a134-37080db91af6 tempest-ProjectReaderTests-498698692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.1b6f0219-2bbb-4484-8dda-ff666ed9a27b" returned: 0 in 0.390s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-73a13af2-fdd7-42a3-a134-37080db91af6 tempest-ProjectReaderTests-498698692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70f1a36b-be8b-44df-8725-082d34e050c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[018ddd6c-d852-4f92-b459-01a9780697b4]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-73a13af2-fdd7-42a3-a134-37080db91af6 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:06 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2 Sep 23 15:29:06 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:06 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594 1073741824" returned: 0 in 0.439s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:06 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:06 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594 Sep 23 15:29:06 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:07 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-73a13af2-fdd7-42a3-a134-37080db91af6 tempest-ProjectReaderTests-498698692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2" returned: 0 in 0.379s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-73a13af2-fdd7-42a3-a134-37080db91af6 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.1b6f0219-2bbb-4484-8dda-ff666ed9a27b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:07 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.1b6f0219-2bbb-4484-8dda-ff666ed9a27b Sep 23 15:29:07 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:07 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594" returned: 0 in 0.277s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a806b2-7bea-4365-8631-ed9b95998823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a65004d-a5f6-48de-952a-10bb61b80594', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5630df3-1e57-4e2b-8435-d8b1974d5391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:07 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Volume volume-3a65004d-a5f6-48de-952a-10bb61b80594 (3a65004d-a5f6-48de-952a-10bb61b80594): created successfully Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5630df3-1e57-4e2b-8435-d8b1974d5391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Flow 'volume_create_manager' (21259656-4402-46bb-bf7a-d775bcf1bead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:29:07 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-115e4b11-d545-460d-b6d8-15ae5db2c717 tempest-ProjectMemberTests-607392192 None] Created volume successfully. Sep 23 15:29:07 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-73a13af2-fdd7-42a3-a134-37080db91af6 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.1b6f0219-2bbb-4484-8dda-ff666ed9a27b" returned: 0 in 0.378s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-73a13af2-fdd7-42a3-a134-37080db91af6 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.1b6f0219-2bbb-4484-8dda-ff666ed9a27b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:07 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.1b6f0219-2bbb-4484-8dda-ff666ed9a27b Sep 23 15:29:07 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-06df6125-f546-4823-bcd9-3417584bcd90 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-06df6125-f546-4823-bcd9-3417584bcd90 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-06df6125-f546-4823-bcd9-3417584bcd90 tempest-ProjectMemberTests-607392192 None] Creating offline snapshot 65a619d7-8311-4fdf-80bc-76f61953005b of volume 3a65004d-a5f6-48de-952a-10bb61b80594 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dec6fc8-43d6-4cce-abe5-27b7d17264d0]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-06df6125-f546-4823-bcd9-3417584bcd90 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:07 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-73a13af2-fdd7-42a3-a134-37080db91af6 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2.1b6f0219-2bbb-4484-8dda-ff666ed9a27b" returned: 0 in 0.298s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:07 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594 Sep 23 15:29:07 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-73a13af2-fdd7-42a3-a134-37080db91af6 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-1b6f0219-2bbb-4484-8dda-ff666ed9a27b" released by "_delete_snapshot" :: held 1.552s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-73a13af2-fdd7-42a3-a134-37080db91af6 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-70f1a36b-be8b-44df-8725-082d34e050c2" released by "delete_snapshot" :: held 1.583s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-73a13af2-fdd7-42a3-a134-37080db91af6 tempest-ProjectReaderTests-498698692 None] Created reservations ['97773b6c-7e97-4ee5-b275-8ff2339fa6a6', '93280159-6bd8-4aba-a24a-3fae75e8d3c0', '7391214a-4dd5-473c-abbf-72bd47bfb825', '801fd439-d04a-45f1-84f6-17a10c3c788e'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:29:07 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-73a13af2-fdd7-42a3-a134-37080db91af6 tempest-ProjectReaderTests-498698692 None] Delete snapshot completed successfully. Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-73a13af2-fdd7-42a3-a134-37080db91af6 tempest-ProjectReaderTests-498698692 None] Lock "cinder-1b6f0219-2bbb-4484-8dda-ff666ed9a27b-delete_snapshot" released by "delete_snapshot" :: held 1.731s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:07 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-06df6125-f546-4823-bcd9-3417584bcd90 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594" returned: 0 in 0.382s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:07 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-06df6125-f546-4823-bcd9-3417584bcd90 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.65a619d7-8311-4fdf-80bc-76f61953005b 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:07 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.65a619d7-8311-4fdf-80bc-76f61953005b 1G Sep 23 15:29:08 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:08 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f23e7aa6-aaef-448b-93b8-04f1f0ac0f9d tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-70f1a36b-be8b-44df-8725-082d34e050c2-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:08 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f23e7aa6-aaef-448b-93b8-04f1f0ac0f9d tempest-ProjectReaderTests-498698692 None] Lock "cinder-70f1a36b-be8b-44df-8725-082d34e050c2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:08 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f23e7aa6-aaef-448b-93b8-04f1f0ac0f9d tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-quobyte-70f1a36b-be8b-44df-8725-082d34e050c2" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:08 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f23e7aa6-aaef-448b-93b8-04f1f0ac0f9d tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-70f1a36b-be8b-44df-8725-082d34e050c2" acquired by "delete_volume" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:08 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:08 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea832c5-a42e-4bdb-99d5-e410789b52c7]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f23e7aa6-aaef-448b-93b8-04f1f0ac0f9d tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-06df6125-f546-4823-bcd9-3417584bcd90 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.65a619d7-8311-4fdf-80bc-76f61953005b 1G" returned: 0 in 0.475s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-06df6125-f546-4823-bcd9-3417584bcd90 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a65004d-a5f6-48de-952a-10bb61b80594 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.65a619d7-8311-4fdf-80bc-76f61953005b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:08 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a65004d-a5f6-48de-952a-10bb61b80594 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.65a619d7-8311-4fdf-80bc-76f61953005b Sep 23 15:29:08 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:08 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2 Sep 23 15:29:08 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:08 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-06df6125-f546-4823-bcd9-3417584bcd90 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a65004d-a5f6-48de-952a-10bb61b80594 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.65a619d7-8311-4fdf-80bc-76f61953005b" returned: 0 in 0.348s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:08 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-06df6125-f546-4823-bcd9-3417584bcd90 tempest-ProjectMemberTests-607392192 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.65a619d7-8311-4fdf-80bc-76f61953005b is being set with open permissions: ugo+rw Sep 23 15:29:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-06df6125-f546-4823-bcd9-3417584bcd90 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.65a619d7-8311-4fdf-80bc-76f61953005b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:08 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f23e7aa6-aaef-448b-93b8-04f1f0ac0f9d tempest-ProjectReaderTests-498698692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2" returned: 0 in 0.375s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:08 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f23e7aa6-aaef-448b-93b8-04f1f0ac0f9d tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:08 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.65a619d7-8311-4fdf-80bc-76f61953005b Sep 23 15:29:08 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:08 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2 Sep 23 15:29:08 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:09 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-06df6125-f546-4823-bcd9-3417584bcd90 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.65a619d7-8311-4fdf-80bc-76f61953005b" returned: 0 in 0.245s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:09 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f23e7aa6-aaef-448b-93b8-04f1f0ac0f9d tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-70f1a36b-be8b-44df-8725-082d34e050c2" returned: 0 in 0.248s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-06df6125-f546-4823-bcd9-3417584bcd90 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:09 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f23e7aa6-aaef-448b-93b8-04f1f0ac0f9d tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-70f1a36b-be8b-44df-8725-082d34e050c2" released by "delete_volume" :: held 0.705s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:09 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.info Sep 23 15:29:09 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:09 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-f23e7aa6-aaef-448b-93b8-04f1f0ac0f9d tempest-ProjectReaderTests-498698692 None] Created reservations ['cc22b03f-f9d6-4df2-98bc-d4b024ef8121', 'fa240211-5d37-444d-95dc-22099e87fcc0', 'adce8784-2399-4dc9-ae64-962a43113179', 'd2796326-6a83-4cf5-ba7e-93ac44765345'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:29:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f23e7aa6-aaef-448b-93b8-04f1f0ac0f9d tempest-ProjectReaderTests-498698692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f23e7aa6-aaef-448b-93b8-04f1f0ac0f9d tempest-ProjectReaderTests-498698692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:09 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f23e7aa6-aaef-448b-93b8-04f1f0ac0f9d tempest-ProjectReaderTests-498698692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:29:09 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f23e7aa6-aaef-448b-93b8-04f1f0ac0f9d tempest-ProjectReaderTests-498698692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:29:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f23e7aa6-aaef-448b-93b8-04f1f0ac0f9d tempest-ProjectReaderTests-498698692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f23e7aa6-aaef-448b-93b8-04f1f0ac0f9d tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:09 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:29:09 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:09 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-06df6125-f546-4823-bcd9-3417584bcd90 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.info" returned: 0 in 0.272s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:09 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-06df6125-f546-4823-bcd9-3417584bcd90 tempest-ProjectMemberTests-607392192 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.info is being set with open permissions: ugo+rw Sep 23 15:29:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-06df6125-f546-4823-bcd9-3417584bcd90 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:09 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.info Sep 23 15:29:09 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:09 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f23e7aa6-aaef-448b-93b8-04f1f0ac0f9d tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.273s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:09 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-f23e7aa6-aaef-448b-93b8-04f1f0ac0f9d tempest-ProjectReaderTests-498698692 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:29:09 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f23e7aa6-aaef-448b-93b8-04f1f0ac0f9d tempest-ProjectReaderTests-498698692 None] Deleted volume successfully. Sep 23 15:29:09 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f23e7aa6-aaef-448b-93b8-04f1f0ac0f9d tempest-ProjectReaderTests-498698692 None] Lock "cinder-70f1a36b-be8b-44df-8725-082d34e050c2-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:09 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-06df6125-f546-4823-bcd9-3417584bcd90 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.info" returned: 0 in 0.278s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:09 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-06df6125-f546-4823-bcd9-3417584bcd90 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.122s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:09 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-06df6125-f546-4823-bcd9-3417584bcd90 tempest-ProjectMemberTests-607392192 None] Create snapshot completed successfully Sep 23 15:29:09 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:29:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Flow 'volume_create_manager' (1378a85f-76fd-4b1c-82da-bf342c8ef50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:29:09 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a215e14-6b82-448f-b41a-4de189e48b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a215e14-6b82-448f-b41a-4de189e48b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-789307138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28cda30a-10b7-470a-a64b-c1d8ce52ffdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fde52c53113485f85c9f1f77a36927e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:29:10Z,use_quota=True,user_id='90a09068610840cfbdf2be72dd01f471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929695f2-58c8-49ad-8ea1-615bac7ec75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929695f2-58c8-49ad-8ea1-615bac7ec75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4964362c-5503-45d1-83e6-45b70ff6dbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4964362c-5503-45d1-83e6-45b70ff6dbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28cda30a-10b7-470a-a64b-c1d8ce52ffdf', 'volume_name': 'volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71722b6c-6044-40f8-b346-8ec0deff8afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71722b6c-6044-40f8-b346-8ec0deff8afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90edde54-8ce5-42f7-8bba-a986e1d6f200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:10 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Volume 28cda30a-10b7-470a-a64b-c1d8ce52ffdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf', 'volume_size': 1} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-789307138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28cda30a-10b7-470a-a64b-c1d8ce52ffdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fde52c53113485f85c9f1f77a36927e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:29:10Z,use_quota=True,user_id='90a09068610840cfbdf2be72dd01f471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Creating volume 28cda30a-10b7-470a-a64b-c1d8ce52ffdf {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:29:10 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:10 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf 1073741824 Sep 23 15:29:10 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:10 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf 1073741824" returned: 0 in 0.431s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:10 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf Sep 23 15:29:10 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c01eaa79-1780-4b06-92ad-81ad177ddd29 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-65a619d7-8311-4fdf-80bc-76f61953005b-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c01eaa79-1780-4b06-92ad-81ad177ddd29 tempest-ProjectMemberTests-607392192 None] Lock "cinder-65a619d7-8311-4fdf-80bc-76f61953005b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c01eaa79-1780-4b06-92ad-81ad177ddd29 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-3a65004d-a5f6-48de-952a-10bb61b80594" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c01eaa79-1780-4b06-92ad-81ad177ddd29 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-3a65004d-a5f6-48de-952a-10bb61b80594" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c01eaa79-1780-4b06-92ad-81ad177ddd29 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-65a619d7-8311-4fdf-80bc-76f61953005b" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c01eaa79-1780-4b06-92ad-81ad177ddd29 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-65a619d7-8311-4fdf-80bc-76f61953005b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-c01eaa79-1780-4b06-92ad-81ad177ddd29 tempest-ProjectMemberTests-607392192 None] Deleting offline snapshot 65a619d7-8311-4fdf-80bc-76f61953005b of volume 3a65004d-a5f6-48de-952a-10bb61b80594 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:29:10 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-c01eaa79-1780-4b06-92ad-81ad177ddd29 tempest-ProjectMemberTests-607392192 None] snapshot_file for this snap is: volume-3a65004d-a5f6-48de-952a-10bb61b80594.65a619d7-8311-4fdf-80bc-76f61953005b {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf" returned: 0 in 0.273s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90edde54-8ce5-42f7-8bba-a986e1d6f200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971217b8-cbb4-4c35-acde-5c22eadf16ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9933c9-5bcf-4cba-96e3-c561021dbc84]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c01eaa79-1780-4b06-92ad-81ad177ddd29 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.65a619d7-8311-4fdf-80bc-76f61953005b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:10 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Volume volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf (28cda30a-10b7-470a-a64b-c1d8ce52ffdf): created successfully Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971217b8-cbb4-4c35-acde-5c22eadf16ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:10 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Flow 'volume_create_manager' (1378a85f-76fd-4b1c-82da-bf342c8ef50e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:29:10 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-223f32aa-0665-4204-a1ec-4c66f4d98b21 tempest-ProjectReaderTests-498698692 None] Created volume successfully. Sep 23 15:29:10 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.65a619d7-8311-4fdf-80bc-76f61953005b Sep 23 15:29:10 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9700f94c-320b-4f4f-9191-27191995677b tempest-ProjectReaderTests-498698692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9700f94c-320b-4f4f-9191-27191995677b tempest-ProjectReaderTests-498698692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-9700f94c-320b-4f4f-9191-27191995677b tempest-ProjectReaderTests-498698692 None] Creating offline snapshot 9a376e6e-73ea-4cee-bdee-1723a2e3e995 of volume 28cda30a-10b7-470a-a64b-c1d8ce52ffdf {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:29:11 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd47021-4537-4071-a07a-f2b846fa4c11]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9700f94c-320b-4f4f-9191-27191995677b tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:11 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c01eaa79-1780-4b06-92ad-81ad177ddd29 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.65a619d7-8311-4fdf-80bc-76f61953005b" returned: 0 in 0.423s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:11 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-c01eaa79-1780-4b06-92ad-81ad177ddd29 tempest-ProjectMemberTests-607392192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a65004d-a5f6-48de-952a-10bb61b80594(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:29:11 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd759cc-811f-411f-aecc-c2775ed8f692]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c01eaa79-1780-4b06-92ad-81ad177ddd29 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:11 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf Sep 23 15:29:11 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:11 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594 Sep 23 15:29:11 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:11 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9700f94c-320b-4f4f-9191-27191995677b tempest-ProjectReaderTests-498698692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf" returned: 0 in 0.386s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9700f94c-320b-4f4f-9191-27191995677b tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.9a376e6e-73ea-4cee-bdee-1723a2e3e995 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:11 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.9a376e6e-73ea-4cee-bdee-1723a2e3e995 1G Sep 23 15:29:11 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:11 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c01eaa79-1780-4b06-92ad-81ad177ddd29 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594" returned: 0 in 0.396s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:11 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c01eaa79-1780-4b06-92ad-81ad177ddd29 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.65a619d7-8311-4fdf-80bc-76f61953005b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:11 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.65a619d7-8311-4fdf-80bc-76f61953005b Sep 23 15:29:11 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:12 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9700f94c-320b-4f4f-9191-27191995677b tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.9a376e6e-73ea-4cee-bdee-1723a2e3e995 1G" returned: 0 in 0.420s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9700f94c-320b-4f4f-9191-27191995677b tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.9a376e6e-73ea-4cee-bdee-1723a2e3e995 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:12 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c01eaa79-1780-4b06-92ad-81ad177ddd29 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.65a619d7-8311-4fdf-80bc-76f61953005b" returned: 0 in 0.360s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c01eaa79-1780-4b06-92ad-81ad177ddd29 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.65a619d7-8311-4fdf-80bc-76f61953005b {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:12 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.9a376e6e-73ea-4cee-bdee-1723a2e3e995 Sep 23 15:29:12 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:12 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.65a619d7-8311-4fdf-80bc-76f61953005b Sep 23 15:29:12 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:12 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-c01eaa79-1780-4b06-92ad-81ad177ddd29 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594.65a619d7-8311-4fdf-80bc-76f61953005b" returned: 0 in 0.268s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:12 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9700f94c-320b-4f4f-9191-27191995677b tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.9a376e6e-73ea-4cee-bdee-1723a2e3e995" returned: 0 in 0.318s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:12 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-9700f94c-320b-4f4f-9191-27191995677b tempest-ProjectReaderTests-498698692 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.9a376e6e-73ea-4cee-bdee-1723a2e3e995 is being set with open permissions: ugo+rw Sep 23 15:29:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9700f94c-320b-4f4f-9191-27191995677b tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.9a376e6e-73ea-4cee-bdee-1723a2e3e995 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c01eaa79-1780-4b06-92ad-81ad177ddd29 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-65a619d7-8311-4fdf-80bc-76f61953005b" released by "_delete_snapshot" :: held 1.580s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c01eaa79-1780-4b06-92ad-81ad177ddd29 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-3a65004d-a5f6-48de-952a-10bb61b80594" released by "delete_snapshot" :: held 1.606s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:12 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.9a376e6e-73ea-4cee-bdee-1723a2e3e995 Sep 23 15:29:12 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:12 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-c01eaa79-1780-4b06-92ad-81ad177ddd29 tempest-ProjectMemberTests-607392192 None] Created reservations ['b27d44cf-dca8-48c2-819d-6d2417bfc3b1', 'aae169c3-fb02-4919-8cb3-8ba80a0841b3', '473b2511-7cc6-4983-b291-0f31d6b77a85', '6d0b6c17-9949-4638-b15f-8bd796ffb8f9'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:29:12 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-c01eaa79-1780-4b06-92ad-81ad177ddd29 tempest-ProjectMemberTests-607392192 None] Delete snapshot completed successfully. Sep 23 15:29:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-c01eaa79-1780-4b06-92ad-81ad177ddd29 tempest-ProjectMemberTests-607392192 None] Lock "cinder-65a619d7-8311-4fdf-80bc-76f61953005b-delete_snapshot" released by "delete_snapshot" :: held 1.747s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:12 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9700f94c-320b-4f4f-9191-27191995677b tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.9a376e6e-73ea-4cee-bdee-1723a2e3e995" returned: 0 in 0.256s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9700f94c-320b-4f4f-9191-27191995677b tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:12 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.info Sep 23 15:29:12 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:12 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f3646de3-facd-4e2b-8fbc-f7843a3b307a tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-3a65004d-a5f6-48de-952a-10bb61b80594-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9700f94c-320b-4f4f-9191-27191995677b tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.info" returned: 0 in 0.270s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:12 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-9700f94c-320b-4f4f-9191-27191995677b tempest-ProjectReaderTests-498698692 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.info is being set with open permissions: ugo+rw Sep 23 15:29:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9700f94c-320b-4f4f-9191-27191995677b tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f3646de3-facd-4e2b-8fbc-f7843a3b307a tempest-ProjectMemberTests-607392192 None] Lock "cinder-3a65004d-a5f6-48de-952a-10bb61b80594-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:12 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.info Sep 23 15:29:12 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f3646de3-facd-4e2b-8fbc-f7843a3b307a tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-3a65004d-a5f6-48de-952a-10bb61b80594" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:12 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f3646de3-facd-4e2b-8fbc-f7843a3b307a tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-3a65004d-a5f6-48de-952a-10bb61b80594" acquired by "delete_volume" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:12 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[addd8127-f60e-4812-8fa9-95458a6acf60]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:12 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f3646de3-facd-4e2b-8fbc-f7843a3b307a tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:13 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594 Sep 23 15:29:13 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:13 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-9700f94c-320b-4f4f-9191-27191995677b tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.info" returned: 0 in 0.268s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-9700f94c-320b-4f4f-9191-27191995677b tempest-ProjectReaderTests-498698692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.995s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:13 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-9700f94c-320b-4f4f-9191-27191995677b tempest-ProjectReaderTests-498698692 None] Create snapshot completed successfully Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ba7ff543-3896-43c0-95d8-ce022f614b38 tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-9a376e6e-73ea-4cee-bdee-1723a2e3e995-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ba7ff543-3896-43c0-95d8-ce022f614b38 tempest-ProjectReaderTests-498698692 None] Lock "cinder-9a376e6e-73ea-4cee-bdee-1723a2e3e995-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ba7ff543-3896-43c0-95d8-ce022f614b38 tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-quobyte-28cda30a-10b7-470a-a64b-c1d8ce52ffdf" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ba7ff543-3896-43c0-95d8-ce022f614b38 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-28cda30a-10b7-470a-a64b-c1d8ce52ffdf" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ba7ff543-3896-43c0-95d8-ce022f614b38 tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-quobyte-9a376e6e-73ea-4cee-bdee-1723a2e3e995" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ba7ff543-3896-43c0-95d8-ce022f614b38 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-9a376e6e-73ea-4cee-bdee-1723a2e3e995" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-ba7ff543-3896-43c0-95d8-ce022f614b38 tempest-ProjectReaderTests-498698692 None] Deleting offline snapshot 9a376e6e-73ea-4cee-bdee-1723a2e3e995 of volume 28cda30a-10b7-470a-a64b-c1d8ce52ffdf {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-ba7ff543-3896-43c0-95d8-ce022f614b38 tempest-ProjectReaderTests-498698692 None] snapshot_file for this snap is: volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.9a376e6e-73ea-4cee-bdee-1723a2e3e995 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:29:13 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[531d5c8b-5e39-4cce-8641-b64e8340310b]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ba7ff543-3896-43c0-95d8-ce022f614b38 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.9a376e6e-73ea-4cee-bdee-1723a2e3e995 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f3646de3-facd-4e2b-8fbc-f7843a3b307a tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594" returned: 0 in 0.417s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f3646de3-facd-4e2b-8fbc-f7843a3b307a tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:13 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594 Sep 23 15:29:13 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:13 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.9a376e6e-73ea-4cee-bdee-1723a2e3e995 Sep 23 15:29:13 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:13 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f3646de3-facd-4e2b-8fbc-f7843a3b307a tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-3a65004d-a5f6-48de-952a-10bb61b80594" returned: 0 in 0.252s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f3646de3-facd-4e2b-8fbc-f7843a3b307a tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-3a65004d-a5f6-48de-952a-10bb61b80594" released by "delete_volume" :: held 0.735s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-f3646de3-facd-4e2b-8fbc-f7843a3b307a tempest-ProjectMemberTests-607392192 None] Created reservations ['edaed745-c3b3-4e50-8ffe-066d02f3bdc0', '3eaeec0f-a4a0-4578-8936-7444b31d15d5', '6cbe2524-7073-4442-af68-b10e63a65fa2', '41677a76-8ad4-4fc2-89a9-0bfbca2c2314'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:29:13 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ba7ff543-3896-43c0-95d8-ce022f614b38 tempest-ProjectReaderTests-498698692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.9a376e6e-73ea-4cee-bdee-1723a2e3e995" returned: 0 in 0.380s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-ba7ff543-3896-43c0-95d8-ce022f614b38 tempest-ProjectReaderTests-498698692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27255f1-6fb1-45b3-ad9a-ad5fb188358d]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ba7ff543-3896-43c0-95d8-ce022f614b38 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f3646de3-facd-4e2b-8fbc-f7843a3b307a tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f3646de3-facd-4e2b-8fbc-f7843a3b307a tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f3646de3-facd-4e2b-8fbc-f7843a3b307a tempest-ProjectMemberTests-607392192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f3646de3-facd-4e2b-8fbc-f7843a3b307a tempest-ProjectMemberTests-607392192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f3646de3-facd-4e2b-8fbc-f7843a3b307a tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:13 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f3646de3-facd-4e2b-8fbc-f7843a3b307a tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:13 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:29:13 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:13 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf Sep 23 15:29:13 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:14 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f3646de3-facd-4e2b-8fbc-f7843a3b307a tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.261s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-f3646de3-facd-4e2b-8fbc-f7843a3b307a tempest-ProjectMemberTests-607392192 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:29:14 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f3646de3-facd-4e2b-8fbc-f7843a3b307a tempest-ProjectMemberTests-607392192 None] Deleted volume successfully. Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-f3646de3-facd-4e2b-8fbc-f7843a3b307a tempest-ProjectMemberTests-607392192 None] Lock "cinder-3a65004d-a5f6-48de-952a-10bb61b80594-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:14 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ba7ff543-3896-43c0-95d8-ce022f614b38 tempest-ProjectReaderTests-498698692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf" returned: 0 in 0.398s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ba7ff543-3896-43c0-95d8-ce022f614b38 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.9a376e6e-73ea-4cee-bdee-1723a2e3e995 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:14 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.9a376e6e-73ea-4cee-bdee-1723a2e3e995 Sep 23 15:29:14 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Flow 'volume_create_manager' (077c1fa0-6b8a-4772-8a63-e07896448c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4744732a-9028-4756-a461-3c340ba9af08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4744732a-9028-4756-a461-3c340ba9af08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1207771974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb2c756-5860-4a0b-80bf-3b378655d1e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66989f39c71404c9b228b7946437c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:29:14Z,use_quota=True,user_id='1a89078dd833490e8539b9c452c2a583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28b166b-3318-43e1-9554-d88ed6732607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28b166b-3318-43e1-9554-d88ed6732607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c5f883-f455-4c22-86ba-427d6e4c3486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c5f883-f455-4c22-86ba-427d6e4c3486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efb2c756-5860-4a0b-80bf-3b378655d1e4', 'volume_name': 'volume-efb2c756-5860-4a0b-80bf-3b378655d1e4', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be781185-75d3-4fa6-8def-8857cc80c436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:14 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be781185-75d3-4fa6-8def-8857cc80c436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6cb07e8-ac33-4021-b766-e5fe03657fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:14 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Volume efb2c756-5860-4a0b-80bf-3b378655d1e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efb2c756-5860-4a0b-80bf-3b378655d1e4', 'volume_size': 1} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1207771974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb2c756-5860-4a0b-80bf-3b378655d1e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66989f39c71404c9b228b7946437c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:29:14Z,use_quota=True,user_id='1a89078dd833490e8539b9c452c2a583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Creating volume efb2c756-5860-4a0b-80bf-3b378655d1e4 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:29:14 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ba7ff543-3896-43c0-95d8-ce022f614b38 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.9a376e6e-73ea-4cee-bdee-1723a2e3e995" returned: 0 in 0.414s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ba7ff543-3896-43c0-95d8-ce022f614b38 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.9a376e6e-73ea-4cee-bdee-1723a2e3e995 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:14 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4 1073741824 Sep 23 15:29:14 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:14 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.9a376e6e-73ea-4cee-bdee-1723a2e3e995 Sep 23 15:29:14 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:14 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ba7ff543-3896-43c0-95d8-ce022f614b38 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf.9a376e6e-73ea-4cee-bdee-1723a2e3e995" returned: 0 in 0.248s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ba7ff543-3896-43c0-95d8-ce022f614b38 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-9a376e6e-73ea-4cee-bdee-1723a2e3e995" released by "_delete_snapshot" :: held 1.542s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ba7ff543-3896-43c0-95d8-ce022f614b38 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-28cda30a-10b7-470a-a64b-c1d8ce52ffdf" released by "delete_snapshot" :: held 1.567s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:14 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-ba7ff543-3896-43c0-95d8-ce022f614b38 tempest-ProjectReaderTests-498698692 None] Created reservations ['edaf67ef-7ad2-4550-a08a-a45f798d2f51', '2cc82de4-25c4-4cc2-94b1-dc58d585f7d1', '84daaca5-fbe9-463b-b6f7-70f676b9a141', 'cdd90223-8f06-47aa-bcf4-30e7553ff3e2'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:29:15 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-ba7ff543-3896-43c0-95d8-ce022f614b38 tempest-ProjectReaderTests-498698692 None] Delete snapshot completed successfully. Sep 23 15:29:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ba7ff543-3896-43c0-95d8-ce022f614b38 tempest-ProjectReaderTests-498698692 None] Lock "cinder-9a376e6e-73ea-4cee-bdee-1723a2e3e995-delete_snapshot" released by "delete_snapshot" :: held 1.721s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:15 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4 1073741824" returned: 0 in 0.454s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:15 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4 Sep 23 15:29:15 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:15 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4" returned: 0 in 0.250s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:29:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6cb07e8-ac33-4021-b766-e5fe03657fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efb2c756-5860-4a0b-80bf-3b378655d1e4', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301db6e6-bf27-4144-ab0e-1417b4a1f4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:15 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Volume volume-efb2c756-5860-4a0b-80bf-3b378655d1e4 (efb2c756-5860-4a0b-80bf-3b378655d1e4): created successfully Sep 23 15:29:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301db6e6-bf27-4144-ab0e-1417b4a1f4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:15 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Flow 'volume_create_manager' (077c1fa0-6b8a-4772-8a63-e07896448c9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:29:15 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-73e62094-bb4b-4738-bad2-c173b4f28c39 tempest-ProjectMemberTests-607392192 None] Created volume successfully. Sep 23 15:29:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-21bdc907-7f46-4d8d-a9be-fad0ce709eb8 tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-28cda30a-10b7-470a-a64b-c1d8ce52ffdf-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-21bdc907-7f46-4d8d-a9be-fad0ce709eb8 tempest-ProjectReaderTests-498698692 None] Lock "cinder-28cda30a-10b7-470a-a64b-c1d8ce52ffdf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-21bdc907-7f46-4d8d-a9be-fad0ce709eb8 tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-quobyte-28cda30a-10b7-470a-a64b-c1d8ce52ffdf" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:15 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-21bdc907-7f46-4d8d-a9be-fad0ce709eb8 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-28cda30a-10b7-470a-a64b-c1d8ce52ffdf" acquired by "delete_volume" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:15 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[569adeb7-a381-4d07-a184-08f99cc69b66]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-21bdc907-7f46-4d8d-a9be-fad0ce709eb8 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6f007df0-04e9-4abc-9ded-1b9525c8cd6d tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6f007df0-04e9-4abc-9ded-1b9525c8cd6d tempest-ProjectMemberTests-607392192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:15 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-6f007df0-04e9-4abc-9ded-1b9525c8cd6d tempest-ProjectMemberTests-607392192 None] Creating offline snapshot 99159492-0d93-48e4-be31-ff5ef832120e of volume efb2c756-5860-4a0b-80bf-3b378655d1e4 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:29:15 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[514e61db-0613-496d-94e1-90924d6cd949]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:15 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6f007df0-04e9-4abc-9ded-1b9525c8cd6d tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:15 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf Sep 23 15:29:15 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:15 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4 Sep 23 15:29:15 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:16 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-21bdc907-7f46-4d8d-a9be-fad0ce709eb8 tempest-ProjectReaderTests-498698692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf" returned: 0 in 0.384s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-21bdc907-7f46-4d8d-a9be-fad0ce709eb8 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:16 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf Sep 23 15:29:16 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:16 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6f007df0-04e9-4abc-9ded-1b9525c8cd6d tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4" returned: 0 in 0.378s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6f007df0-04e9-4abc-9ded-1b9525c8cd6d tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.99159492-0d93-48e4-be31-ff5ef832120e 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:16 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.99159492-0d93-48e4-be31-ff5ef832120e 1G Sep 23 15:29:16 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:16 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-21bdc907-7f46-4d8d-a9be-fad0ce709eb8 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-28cda30a-10b7-470a-a64b-c1d8ce52ffdf" returned: 0 in 0.269s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-21bdc907-7f46-4d8d-a9be-fad0ce709eb8 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-28cda30a-10b7-470a-a64b-c1d8ce52ffdf" released by "delete_volume" :: held 0.739s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:16 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-21bdc907-7f46-4d8d-a9be-fad0ce709eb8 tempest-ProjectReaderTests-498698692 None] Created reservations ['544042ef-bda0-478d-8f3f-ed3440cc9296', '206d17ff-84ed-4948-8393-031b581ae85c', 'e10c459e-ac4e-4363-a7aa-ade2cc95d14a', '58cefc36-70d6-4b7f-8494-d72c4d11cb4f'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:29:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-21bdc907-7f46-4d8d-a9be-fad0ce709eb8 tempest-ProjectReaderTests-498698692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-21bdc907-7f46-4d8d-a9be-fad0ce709eb8 tempest-ProjectReaderTests-498698692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-21bdc907-7f46-4d8d-a9be-fad0ce709eb8 tempest-ProjectReaderTests-498698692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:29:16 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-21bdc907-7f46-4d8d-a9be-fad0ce709eb8 tempest-ProjectReaderTests-498698692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:29:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-21bdc907-7f46-4d8d-a9be-fad0ce709eb8 tempest-ProjectReaderTests-498698692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-21bdc907-7f46-4d8d-a9be-fad0ce709eb8 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:16 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:29:16 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:16 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6f007df0-04e9-4abc-9ded-1b9525c8cd6d tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.99159492-0d93-48e4-be31-ff5ef832120e 1G" returned: 0 in 0.458s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6f007df0-04e9-4abc-9ded-1b9525c8cd6d tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efb2c756-5860-4a0b-80bf-3b378655d1e4 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.99159492-0d93-48e4-be31-ff5ef832120e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:16 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efb2c756-5860-4a0b-80bf-3b378655d1e4 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.99159492-0d93-48e4-be31-ff5ef832120e Sep 23 15:29:16 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:16 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-21bdc907-7f46-4d8d-a9be-fad0ce709eb8 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.299s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:16 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-21bdc907-7f46-4d8d-a9be-fad0ce709eb8 tempest-ProjectReaderTests-498698692 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:29:16 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-21bdc907-7f46-4d8d-a9be-fad0ce709eb8 tempest-ProjectReaderTests-498698692 None] Deleted volume successfully. Sep 23 15:29:16 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-21bdc907-7f46-4d8d-a9be-fad0ce709eb8 tempest-ProjectReaderTests-498698692 None] Lock "cinder-28cda30a-10b7-470a-a64b-c1d8ce52ffdf-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:16 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6f007df0-04e9-4abc-9ded-1b9525c8cd6d tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efb2c756-5860-4a0b-80bf-3b378655d1e4 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.99159492-0d93-48e4-be31-ff5ef832120e" returned: 0 in 0.356s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:16 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-6f007df0-04e9-4abc-9ded-1b9525c8cd6d tempest-ProjectMemberTests-607392192 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.99159492-0d93-48e4-be31-ff5ef832120e is being set with open permissions: ugo+rw Sep 23 15:29:16 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6f007df0-04e9-4abc-9ded-1b9525c8cd6d tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.99159492-0d93-48e4-be31-ff5ef832120e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:16 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.99159492-0d93-48e4-be31-ff5ef832120e Sep 23 15:29:16 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:29:17 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Flow 'volume_create_manager' (6a2ed88c-2716-41be-9e11-bbeb7637121d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc4b5a9c-adf6-4ccb-8746-a9f701a66840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6f007df0-04e9-4abc-9ded-1b9525c8cd6d tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.99159492-0d93-48e4-be31-ff5ef832120e" returned: 0 in 0.301s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc4b5a9c-adf6-4ccb-8746-a9f701a66840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-293244302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd526e5-626c-41da-84ba-b1f75829441d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fde52c53113485f85c9f1f77a36927e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:29:17Z,use_quota=True,user_id='90a09068610840cfbdf2be72dd01f471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912642cd-ea53-47b5-802b-c1ba9037eadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912642cd-ea53-47b5-802b-c1ba9037eadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db89b00-e512-4be9-a222-567a25883dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db89b00-e512-4be9-a222-567a25883dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcd526e5-626c-41da-84ba-b1f75829441d', 'volume_name': 'volume-bcd526e5-626c-41da-84ba-b1f75829441d', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c377a56b-1e83-4542-a078-d4691fcb9cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c377a56b-1e83-4542-a078-d4691fcb9cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9beef365-169b-4137-83ff-4c24e8bca36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:17 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Volume bcd526e5-626c-41da-84ba-b1f75829441d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcd526e5-626c-41da-84ba-b1f75829441d', 'volume_size': 1} Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6f007df0-04e9-4abc-9ded-1b9525c8cd6d tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:17 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.info Sep 23 15:29:17 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:17 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6f007df0-04e9-4abc-9ded-1b9525c8cd6d tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.info" returned: 0 in 0.252s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:17 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-6f007df0-04e9-4abc-9ded-1b9525c8cd6d tempest-ProjectMemberTests-607392192 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.info is being set with open permissions: ugo+rw Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6f007df0-04e9-4abc-9ded-1b9525c8cd6d tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:17 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.info Sep 23 15:29:17 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:17 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-6f007df0-04e9-4abc-9ded-1b9525c8cd6d tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.info" returned: 0 in 0.243s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-6f007df0-04e9-4abc-9ded-1b9525c8cd6d tempest-ProjectMemberTests-607392192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.119s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.535s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-293244302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd526e5-626c-41da-84ba-b1f75829441d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fde52c53113485f85c9f1f77a36927e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:29:17Z,use_quota=True,user_id='90a09068610840cfbdf2be72dd01f471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Creating volume bcd526e5-626c-41da-84ba-b1f75829441d {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:29:17 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:29:17 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:17 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d 1073741824 Sep 23 15:29:17 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:17 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-6f007df0-04e9-4abc-9ded-1b9525c8cd6d tempest-ProjectMemberTests-607392192 None] Create snapshot completed successfully Sep 23 15:29:18 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d 1073741824" returned: 0 in 0.425s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:18 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d Sep 23 15:29:18 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:18 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d" returned: 0 in 0.241s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:29:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:18 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9beef365-169b-4137-83ff-4c24e8bca36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcd526e5-626c-41da-84ba-b1f75829441d', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:18 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57888c9f-ba9f-4cc8-9a65-17926f7beedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:18 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Volume volume-bcd526e5-626c-41da-84ba-b1f75829441d (bcd526e5-626c-41da-84ba-b1f75829441d): created successfully Sep 23 15:29:18 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57888c9f-ba9f-4cc8-9a65-17926f7beedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:18 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Flow 'volume_create_manager' (6a2ed88c-2716-41be-9e11-bbeb7637121d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:29:18 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-529a43f1-5206-470c-9f13-576ffe230955 tempest-ProjectReaderTests-498698692 None] Created volume successfully. Sep 23 15:29:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7bfa6019-f4d2-46e7-a42c-c3159dc32f41 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-99159492-0d93-48e4-be31-ff5ef832120e-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7bfa6019-f4d2-46e7-a42c-c3159dc32f41 tempest-ProjectMemberTests-607392192 None] Lock "cinder-99159492-0d93-48e4-be31-ff5ef832120e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7bfa6019-f4d2-46e7-a42c-c3159dc32f41 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-efb2c756-5860-4a0b-80bf-3b378655d1e4" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7bfa6019-f4d2-46e7-a42c-c3159dc32f41 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-efb2c756-5860-4a0b-80bf-3b378655d1e4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7bfa6019-f4d2-46e7-a42c-c3159dc32f41 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-99159492-0d93-48e4-be31-ff5ef832120e" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:18 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7bfa6019-f4d2-46e7-a42c-c3159dc32f41 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-99159492-0d93-48e4-be31-ff5ef832120e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-7bfa6019-f4d2-46e7-a42c-c3159dc32f41 tempest-ProjectMemberTests-607392192 None] Deleting offline snapshot 99159492-0d93-48e4-be31-ff5ef832120e of volume efb2c756-5860-4a0b-80bf-3b378655d1e4 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:29:18 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-7bfa6019-f4d2-46e7-a42c-c3159dc32f41 tempest-ProjectMemberTests-607392192 None] snapshot_file for this snap is: volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.99159492-0d93-48e4-be31-ff5ef832120e {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:29:18 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[572f0d0a-6420-42f8-b612-f9905c9f4eb3]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:18 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7bfa6019-f4d2-46e7-a42c-c3159dc32f41 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.99159492-0d93-48e4-be31-ff5ef832120e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:19 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.99159492-0d93-48e4-be31-ff5ef832120e Sep 23 15:29:19 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:19 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7bfa6019-f4d2-46e7-a42c-c3159dc32f41 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.99159492-0d93-48e4-be31-ff5ef832120e" returned: 0 in 0.392s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-7bfa6019-f4d2-46e7-a42c-c3159dc32f41 tempest-ProjectMemberTests-607392192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efb2c756-5860-4a0b-80bf-3b378655d1e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:29:19 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec4f696-e8f6-4bf9-b112-1b31e944cf9e]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7bfa6019-f4d2-46e7-a42c-c3159dc32f41 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3e2c3ccd-c318-4e87-9c65-4bce6440ab6f tempest-ProjectReaderTests-498698692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3e2c3ccd-c318-4e87-9c65-4bce6440ab6f tempest-ProjectReaderTests-498698692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:19 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-3e2c3ccd-c318-4e87-9c65-4bce6440ab6f tempest-ProjectReaderTests-498698692 None] Creating offline snapshot 24390d1a-4ff5-4326-83fd-e577a5a34dc9 of volume bcd526e5-626c-41da-84ba-b1f75829441d {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:29:19 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[df673333-0eb4-471a-bf52-3dd2fba7b0a6]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e2c3ccd-c318-4e87-9c65-4bce6440ab6f tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:19 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4 Sep 23 15:29:19 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:19 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d Sep 23 15:29:19 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:19 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7bfa6019-f4d2-46e7-a42c-c3159dc32f41 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4" returned: 0 in 0.386s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7bfa6019-f4d2-46e7-a42c-c3159dc32f41 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.99159492-0d93-48e4-be31-ff5ef832120e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:19 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.99159492-0d93-48e4-be31-ff5ef832120e Sep 23 15:29:19 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:19 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e2c3ccd-c318-4e87-9c65-4bce6440ab6f tempest-ProjectReaderTests-498698692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d" returned: 0 in 0.404s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:19 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e2c3ccd-c318-4e87-9c65-4bce6440ab6f tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.24390d1a-4ff5-4326-83fd-e577a5a34dc9 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:19 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.24390d1a-4ff5-4326-83fd-e577a5a34dc9 1G Sep 23 15:29:19 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:20 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7bfa6019-f4d2-46e7-a42c-c3159dc32f41 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.99159492-0d93-48e4-be31-ff5ef832120e" returned: 0 in 0.360s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7bfa6019-f4d2-46e7-a42c-c3159dc32f41 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.99159492-0d93-48e4-be31-ff5ef832120e {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:20 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.99159492-0d93-48e4-be31-ff5ef832120e Sep 23 15:29:20 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:20 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e2c3ccd-c318-4e87-9c65-4bce6440ab6f tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.24390d1a-4ff5-4326-83fd-e577a5a34dc9 1G" returned: 0 in 0.460s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e2c3ccd-c318-4e87-9c65-4bce6440ab6f tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcd526e5-626c-41da-84ba-b1f75829441d -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.24390d1a-4ff5-4326-83fd-e577a5a34dc9 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:20 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcd526e5-626c-41da-84ba-b1f75829441d -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.24390d1a-4ff5-4326-83fd-e577a5a34dc9 Sep 23 15:29:20 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:20 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-7bfa6019-f4d2-46e7-a42c-c3159dc32f41 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4.99159492-0d93-48e4-be31-ff5ef832120e" returned: 0 in 0.304s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7bfa6019-f4d2-46e7-a42c-c3159dc32f41 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-99159492-0d93-48e4-be31-ff5ef832120e" released by "_delete_snapshot" :: held 1.565s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7bfa6019-f4d2-46e7-a42c-c3159dc32f41 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-efb2c756-5860-4a0b-80bf-3b378655d1e4" released by "delete_snapshot" :: held 1.591s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:20 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-7bfa6019-f4d2-46e7-a42c-c3159dc32f41 tempest-ProjectMemberTests-607392192 None] Created reservations ['6bd9a28d-4f28-48d5-a327-d4f59d5d10da', '42e64496-6829-4cca-a196-f19d9becaaf7', 'e5c58803-8df4-463e-af56-4ce4f6af8331', 'd89643ab-e46f-4dc1-8c15-ae44a14d05c0'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:29:20 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-7bfa6019-f4d2-46e7-a42c-c3159dc32f41 tempest-ProjectMemberTests-607392192 None] Delete snapshot completed successfully. Sep 23 15:29:20 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-7bfa6019-f4d2-46e7-a42c-c3159dc32f41 tempest-ProjectMemberTests-607392192 None] Lock "cinder-99159492-0d93-48e4-be31-ff5ef832120e-delete_snapshot" released by "delete_snapshot" :: held 1.739s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:20 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e2c3ccd-c318-4e87-9c65-4bce6440ab6f tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcd526e5-626c-41da-84ba-b1f75829441d -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.24390d1a-4ff5-4326-83fd-e577a5a34dc9" returned: 0 in 0.324s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:20 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-3e2c3ccd-c318-4e87-9c65-4bce6440ab6f tempest-ProjectReaderTests-498698692 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.24390d1a-4ff5-4326-83fd-e577a5a34dc9 is being set with open permissions: ugo+rw Sep 23 15:29:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e2c3ccd-c318-4e87-9c65-4bce6440ab6f tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.24390d1a-4ff5-4326-83fd-e577a5a34dc9 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:20 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.24390d1a-4ff5-4326-83fd-e577a5a34dc9 Sep 23 15:29:20 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:20 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e2c3ccd-c318-4e87-9c65-4bce6440ab6f tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.24390d1a-4ff5-4326-83fd-e577a5a34dc9" returned: 0 in 0.249s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:20 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e2c3ccd-c318-4e87-9c65-4bce6440ab6f tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:21 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.info Sep 23 15:29:21 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3f01f8c8-04fd-4c90-b43f-07c909378b30 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-efb2c756-5860-4a0b-80bf-3b378655d1e4-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3f01f8c8-04fd-4c90-b43f-07c909378b30 tempest-ProjectMemberTests-607392192 None] Lock "cinder-efb2c756-5860-4a0b-80bf-3b378655d1e4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3f01f8c8-04fd-4c90-b43f-07c909378b30 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-efb2c756-5860-4a0b-80bf-3b378655d1e4" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3f01f8c8-04fd-4c90-b43f-07c909378b30 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-efb2c756-5860-4a0b-80bf-3b378655d1e4" acquired by "delete_volume" :: waited 0.016s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:21 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[885dc518-4ab0-4e95-955a-c050cdf51bc7]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3f01f8c8-04fd-4c90-b43f-07c909378b30 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:21 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e2c3ccd-c318-4e87-9c65-4bce6440ab6f tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.info" returned: 0 in 0.295s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:21 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-3e2c3ccd-c318-4e87-9c65-4bce6440ab6f tempest-ProjectReaderTests-498698692 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.info is being set with open permissions: ugo+rw Sep 23 15:29:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e2c3ccd-c318-4e87-9c65-4bce6440ab6f tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:21 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.info Sep 23 15:29:21 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:21 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4 Sep 23 15:29:21 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:21 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3e2c3ccd-c318-4e87-9c65-4bce6440ab6f tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.info" returned: 0 in 0.283s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3e2c3ccd-c318-4e87-9c65-4bce6440ab6f tempest-ProjectReaderTests-498698692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.108s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:21 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3f01f8c8-04fd-4c90-b43f-07c909378b30 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4" returned: 0 in 0.394s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3f01f8c8-04fd-4c90-b43f-07c909378b30 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:21 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-3e2c3ccd-c318-4e87-9c65-4bce6440ab6f tempest-ProjectReaderTests-498698692 None] Create snapshot completed successfully Sep 23 15:29:21 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4 Sep 23 15:29:21 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:21 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3f01f8c8-04fd-4c90-b43f-07c909378b30 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-efb2c756-5860-4a0b-80bf-3b378655d1e4" returned: 0 in 0.253s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:21 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3f01f8c8-04fd-4c90-b43f-07c909378b30 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-efb2c756-5860-4a0b-80bf-3b378655d1e4" released by "delete_volume" :: held 0.719s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:21 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-3f01f8c8-04fd-4c90-b43f-07c909378b30 tempest-ProjectMemberTests-607392192 None] Created reservations ['cd87c0b3-7161-415c-80d5-4a3d95673172', '1bf8459f-5095-4686-b9df-da0b4e62355f', 'ee43aa01-34e8-4bf5-9883-e48456975708', 'e9972d2f-da31-4ef6-951f-cf3950eb8e57'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:29:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3f01f8c8-04fd-4c90-b43f-07c909378b30 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3f01f8c8-04fd-4c90-b43f-07c909378b30 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3f01f8c8-04fd-4c90-b43f-07c909378b30 tempest-ProjectMemberTests-607392192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:29:21 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-3f01f8c8-04fd-4c90-b43f-07c909378b30 tempest-ProjectMemberTests-607392192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:29:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-3f01f8c8-04fd-4c90-b43f-07c909378b30 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:21 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3f01f8c8-04fd-4c90-b43f-07c909378b30 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:22 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:29:22 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:22 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-3f01f8c8-04fd-4c90-b43f-07c909378b30 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.265s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-3f01f8c8-04fd-4c90-b43f-07c909378b30 tempest-ProjectMemberTests-607392192 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:29:22 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-3f01f8c8-04fd-4c90-b43f-07c909378b30 tempest-ProjectMemberTests-607392192 None] Deleted volume successfully. Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-3f01f8c8-04fd-4c90-b43f-07c909378b30 tempest-ProjectMemberTests-607392192 None] Lock "cinder-efb2c756-5860-4a0b-80bf-3b378655d1e4-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ba447b54-08bc-4336-a431-dbe179f81ad9 tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-24390d1a-4ff5-4326-83fd-e577a5a34dc9-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ba447b54-08bc-4336-a431-dbe179f81ad9 tempest-ProjectReaderTests-498698692 None] Lock "cinder-24390d1a-4ff5-4326-83fd-e577a5a34dc9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ba447b54-08bc-4336-a431-dbe179f81ad9 tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-quobyte-bcd526e5-626c-41da-84ba-b1f75829441d" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ba447b54-08bc-4336-a431-dbe179f81ad9 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-bcd526e5-626c-41da-84ba-b1f75829441d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ba447b54-08bc-4336-a431-dbe179f81ad9 tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-quobyte-24390d1a-4ff5-4326-83fd-e577a5a34dc9" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.volume.flows.manager.create_volume [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86064) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Flow 'volume_create_manager' (03a9aa5b-7873-4e65-b192-6f67a90795cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (631c0592-4a08-40da-bdeb-f9e84489ff3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ba447b54-08bc-4336-a431-dbe179f81ad9 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-24390d1a-4ff5-4326-83fd-e577a5a34dc9" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-ba447b54-08bc-4336-a431-dbe179f81ad9 tempest-ProjectReaderTests-498698692 None] Deleting offline snapshot 24390d1a-4ff5-4326-83fd-e577a5a34dc9 of volume bcd526e5-626c-41da-84ba-b1f75829441d {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-ba447b54-08bc-4336-a431-dbe179f81ad9 tempest-ProjectReaderTests-498698692 None] snapshot_file for this snap is: volume-bcd526e5-626c-41da-84ba-b1f75829441d.24390d1a-4ff5-4326-83fd-e577a5a34dc9 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (631c0592-4a08-40da-bdeb-f9e84489ff3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-966863628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba899c79-adf1-4404-858a-ee70d738dcf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66989f39c71404c9b228b7946437c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:29:23Z,use_quota=True,user_id='1a89078dd833490e8539b9c452c2a583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e5b121-59d1-40f3-8181-05d9a973bebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e5b121-59d1-40f3-8181-05d9a973bebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab32288-8d00-480c-84e3-316abd41d479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab32288-8d00-480c-84e3-316abd41d479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba899c79-adf1-4404-858a-ee70d738dcf2', 'volume_name': 'volume-ba899c79-adf1-4404-858a-ee70d738dcf2', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d011cd11-f53a-4e42-8628-dfa87045f89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d011cd11-f53a-4e42-8628-dfa87045f89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d45d8b-db28-4bc4-a995-4cf41f925a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:22 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Volume ba899c79-adf1-4404-858a-ee70d738dcf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba899c79-adf1-4404-858a-ee70d738dcf2', 'volume_size': 1} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T13:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-966863628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba899c79-adf1-4404-858a-ee70d738dcf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66989f39c71404c9b228b7946437c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T13:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T13:29:23Z,use_quota=True,user_id='1a89078dd833490e8539b9c452c2a583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f97e5f-10b3-4531-856f-075d4eb8ba6b),volume_type_id=06f97e5f-10b3-4531-856f-075d4eb8ba6b)}" {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Creating volume ba899c79-adf1-4404-858a-ee70d738dcf2 {{(pid=86064) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Selected osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 as target Quobyte volume. {{(pid=86064) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 15:29:22 devstack cinder-volume[86064]: INFO cinder.volume.drivers.remotefs [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] casted to osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8 Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2 1073741824 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0129fdc-eda1-45fd-aff4-924a9f07983a]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:22 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ba447b54-08bc-4336-a431-dbe179f81ad9 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.24390d1a-4ff5-4326-83fd-e577a5a34dc9 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:22 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2 1073741824 Sep 23 15:29:22 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:22 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.24390d1a-4ff5-4326-83fd-e577a5a34dc9 Sep 23 15:29:22 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:23 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ba447b54-08bc-4336-a431-dbe179f81ad9 tempest-ProjectReaderTests-498698692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.24390d1a-4ff5-4326-83fd-e577a5a34dc9" returned: 0 in 0.421s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:23 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-ba447b54-08bc-4336-a431-dbe179f81ad9 tempest-ProjectReaderTests-498698692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcd526e5-626c-41da-84ba-b1f75829441d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:29:23 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2 1073741824" returned: 0 in 0.472s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:23 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[748d26db-89e2-458d-baaa-741fb9ebac53]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ba447b54-08bc-4336-a431-dbe179f81ad9 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:23 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2 Sep 23 15:29:23 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:23 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d Sep 23 15:29:23 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:23 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2" returned: 0 in 0.287s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:23 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'} {{(pid=86064) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 15:29:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d45d8b-db28-4bc4-a995-4cf41f925a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba899c79-adf1-4404-858a-ee70d738dcf2', 'volume_size': 1}' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8f02ea-1d2c-40df-84a5-f4fa6c141fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 15:29:23 devstack cinder-volume[86064]: INFO cinder.volume.flows.manager.create_volume [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Volume volume-ba899c79-adf1-4404-858a-ee70d738dcf2 (ba899c79-adf1-4404-858a-ee70d738dcf2): created successfully Sep 23 15:29:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8f02ea-1d2c-40df-84a5-f4fa6c141fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86064) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 15:29:23 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Flow 'volume_create_manager' (03a9aa5b-7873-4e65-b192-6f67a90795cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86064) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 15:29:23 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ba447b54-08bc-4336-a431-dbe179f81ad9 tempest-ProjectReaderTests-498698692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d" returned: 0 in 0.411s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:23 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ba447b54-08bc-4336-a431-dbe179f81ad9 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.24390d1a-4ff5-4326-83fd-e577a5a34dc9 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:23 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-f145ecda-c529-400c-981f-3af04e0b25a7 tempest-ProjectMemberTests-607392192 None] Created volume successfully. Sep 23 15:29:23 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.24390d1a-4ff5-4326-83fd-e577a5a34dc9 Sep 23 15:29:23 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:24 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ba447b54-08bc-4336-a431-dbe179f81ad9 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.24390d1a-4ff5-4326-83fd-e577a5a34dc9" returned: 0 in 0.336s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ba447b54-08bc-4336-a431-dbe179f81ad9 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.24390d1a-4ff5-4326-83fd-e577a5a34dc9 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:24 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.24390d1a-4ff5-4326-83fd-e577a5a34dc9 Sep 23 15:29:24 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:24 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:24 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-ba447b54-08bc-4336-a431-dbe179f81ad9 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d.24390d1a-4ff5-4326-83fd-e577a5a34dc9" returned: 0 in 0.264s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ba447b54-08bc-4336-a431-dbe179f81ad9 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-24390d1a-4ff5-4326-83fd-e577a5a34dc9" released by "_delete_snapshot" :: held 1.612s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ba447b54-08bc-4336-a431-dbe179f81ad9 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-bcd526e5-626c-41da-84ba-b1f75829441d" released by "delete_snapshot" :: held 1.670s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:24 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-ba447b54-08bc-4336-a431-dbe179f81ad9 tempest-ProjectReaderTests-498698692 None] Created reservations ['159cdb0c-fcaa-47f1-968d-41fd81d782cd', '608925c6-16d4-4b07-92c2-fbc34afa4acc', 'b58067c6-c6f8-4634-8aeb-058fdfd2b433', '3e5b977e-9528-40b1-9b0b-36a7c033176f'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:29:24 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-ba447b54-08bc-4336-a431-dbe179f81ad9 tempest-ProjectReaderTests-498698692 None] Delete snapshot completed successfully. Sep 23 15:29:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-ba447b54-08bc-4336-a431-dbe179f81ad9 tempest-ProjectReaderTests-498698692 None] Lock "cinder-24390d1a-4ff5-4326-83fd-e577a5a34dc9-delete_snapshot" released by "delete_snapshot" :: held 1.824s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-776a44ce-f980-4a5d-9fc8-409477283d05 tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-bcd526e5-626c-41da-84ba-b1f75829441d-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-776a44ce-f980-4a5d-9fc8-409477283d05 tempest-ProjectReaderTests-498698692 None] Lock "cinder-bcd526e5-626c-41da-84ba-b1f75829441d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-776a44ce-f980-4a5d-9fc8-409477283d05 tempest-ProjectReaderTests-498698692 None] Acquiring lock "cinder-quobyte-bcd526e5-626c-41da-84ba-b1f75829441d" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:24 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-776a44ce-f980-4a5d-9fc8-409477283d05 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-bcd526e5-626c-41da-84ba-b1f75829441d" acquired by "delete_volume" :: waited 0.021s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:25 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cee829-f4c8-4606-afa8-2b806a81aea3]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-776a44ce-f980-4a5d-9fc8-409477283d05 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a10c242c-645d-4cd6-b6a4-ffc025adc647 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a10c242c-645d-4cd6-b6a4-ffc025adc647 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-a10c242c-645d-4cd6-b6a4-ffc025adc647 tempest-ProjectMemberTests-607392192 None] Creating offline snapshot 3c146b23-763d-44d8-a150-69cf8789697c of volume ba899c79-adf1-4404-858a-ee70d738dcf2 {{(pid=86064) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 15:29:25 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba015ed-01bb-4e9f-9ba9-9818b0bace80]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a10c242c-645d-4cd6-b6a4-ffc025adc647 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:25 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d Sep 23 15:29:25 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:25 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2 Sep 23 15:29:25 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:25 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-776a44ce-f980-4a5d-9fc8-409477283d05 tempest-ProjectReaderTests-498698692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d" returned: 0 in 0.421s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-776a44ce-f980-4a5d-9fc8-409477283d05 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:25 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d Sep 23 15:29:25 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:25 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a10c242c-645d-4cd6-b6a4-ffc025adc647 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2" returned: 0 in 0.410s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a10c242c-645d-4cd6-b6a4-ffc025adc647 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.3c146b23-763d-44d8-a150-69cf8789697c 1G {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:25 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.3c146b23-763d-44d8-a150-69cf8789697c 1G Sep 23 15:29:25 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:25 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-776a44ce-f980-4a5d-9fc8-409477283d05 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-bcd526e5-626c-41da-84ba-b1f75829441d" returned: 0 in 0.304s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:25 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-776a44ce-f980-4a5d-9fc8-409477283d05 tempest-ProjectReaderTests-498698692 None] Lock "cinder-quobyte-bcd526e5-626c-41da-84ba-b1f75829441d" released by "delete_volume" :: held 0.805s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:25 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-776a44ce-f980-4a5d-9fc8-409477283d05 tempest-ProjectReaderTests-498698692 None] Created reservations ['a4f565f6-0ebd-4cb2-8c4d-f9f692539a54', 'c6450537-1310-4f85-9263-88f32422aa6d', 'a3e82d8b-000e-4f38-b85a-113cbfed2604', '57b11706-7831-4a9e-ad8c-6e0bc2d8d8ce'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:29:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-776a44ce-f980-4a5d-9fc8-409477283d05 tempest-ProjectReaderTests-498698692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-776a44ce-f980-4a5d-9fc8-409477283d05 tempest-ProjectReaderTests-498698692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-776a44ce-f980-4a5d-9fc8-409477283d05 tempest-ProjectReaderTests-498698692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:29:25 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-776a44ce-f980-4a5d-9fc8-409477283d05 tempest-ProjectReaderTests-498698692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:29:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-776a44ce-f980-4a5d-9fc8-409477283d05 tempest-ProjectReaderTests-498698692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-776a44ce-f980-4a5d-9fc8-409477283d05 tempest-ProjectReaderTests-498698692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:25 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:25 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:29:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a10c242c-645d-4cd6-b6a4-ffc025adc647 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.3c146b23-763d-44d8-a150-69cf8789697c 1G" returned: 0 in 0.485s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:25 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a10c242c-645d-4cd6-b6a4-ffc025adc647 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba899c79-adf1-4404-858a-ee70d738dcf2 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.3c146b23-763d-44d8-a150-69cf8789697c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:25 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:25 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba899c79-adf1-4404-858a-ee70d738dcf2 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.3c146b23-763d-44d8-a150-69cf8789697c Sep 23 15:29:25 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:26 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-776a44ce-f980-4a5d-9fc8-409477283d05 tempest-ProjectReaderTests-498698692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.267s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:26 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-776a44ce-f980-4a5d-9fc8-409477283d05 tempest-ProjectReaderTests-498698692 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:29:26 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-776a44ce-f980-4a5d-9fc8-409477283d05 tempest-ProjectReaderTests-498698692 None] Deleted volume successfully. Sep 23 15:29:26 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-776a44ce-f980-4a5d-9fc8-409477283d05 tempest-ProjectReaderTests-498698692 None] Lock "cinder-bcd526e5-626c-41da-84ba-b1f75829441d-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:26 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a10c242c-645d-4cd6-b6a4-ffc025adc647 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba899c79-adf1-4404-858a-ee70d738dcf2 -F qcow2 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.3c146b23-763d-44d8-a150-69cf8789697c" returned: 0 in 0.347s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:26 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-a10c242c-645d-4cd6-b6a4-ffc025adc647 tempest-ProjectMemberTests-607392192 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.3c146b23-763d-44d8-a150-69cf8789697c is being set with open permissions: ugo+rw Sep 23 15:29:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a10c242c-645d-4cd6-b6a4-ffc025adc647 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.3c146b23-763d-44d8-a150-69cf8789697c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:26 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.3c146b23-763d-44d8-a150-69cf8789697c Sep 23 15:29:26 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:26 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a10c242c-645d-4cd6-b6a4-ffc025adc647 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.3c146b23-763d-44d8-a150-69cf8789697c" returned: 0 in 0.271s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a10c242c-645d-4cd6-b6a4-ffc025adc647 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:26 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.info Sep 23 15:29:26 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:26 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a10c242c-645d-4cd6-b6a4-ffc025adc647 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.info" returned: 0 in 0.269s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:26 devstack cinder-volume[86064]: WARNING cinder.volume.drivers.remotefs [None req-a10c242c-645d-4cd6-b6a4-ffc025adc647 tempest-ProjectMemberTests-607392192 None] /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.info is being set with open permissions: ugo+rw Sep 23 15:29:26 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a10c242c-645d-4cd6-b6a4-ffc025adc647 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.info {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:26 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.info Sep 23 15:29:26 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:27 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-a10c242c-645d-4cd6-b6a4-ffc025adc647 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.info" returned: 0 in 0.271s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:27 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-a10c242c-645d-4cd6-b6a4-ffc025adc647 tempest-ProjectMemberTests-607392192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.145s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:27 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-a10c242c-645d-4cd6-b6a4-ffc025adc647 tempest-ProjectMemberTests-607392192 None] Create snapshot completed successfully Sep 23 15:29:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1a39da17-401f-43d1-a0a0-8c7a3cc79424 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-3c146b23-763d-44d8-a150-69cf8789697c-delete_snapshot" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1a39da17-401f-43d1-a0a0-8c7a3cc79424 tempest-ProjectMemberTests-607392192 None] Lock "cinder-3c146b23-763d-44d8-a150-69cf8789697c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1a39da17-401f-43d1-a0a0-8c7a3cc79424 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-ba899c79-adf1-4404-858a-ee70d738dcf2" by "delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1a39da17-401f-43d1-a0a0-8c7a3cc79424 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-ba899c79-adf1-4404-858a-ee70d738dcf2" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1a39da17-401f-43d1-a0a0-8c7a3cc79424 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-3c146b23-763d-44d8-a150-69cf8789697c" by "_delete_snapshot" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:28 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1a39da17-401f-43d1-a0a0-8c7a3cc79424 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-3c146b23-763d-44d8-a150-69cf8789697c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-1a39da17-401f-43d1-a0a0-8c7a3cc79424 tempest-ProjectMemberTests-607392192 None] Deleting offline snapshot 3c146b23-763d-44d8-a150-69cf8789697c of volume ba899c79-adf1-4404-858a-ee70d738dcf2 {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 15:29:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-1a39da17-401f-43d1-a0a0-8c7a3cc79424 tempest-ProjectMemberTests-607392192 None] snapshot_file for this snap is: volume-ba899c79-adf1-4404-858a-ee70d738dcf2.3c146b23-763d-44d8-a150-69cf8789697c {{(pid=86064) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 15:29:28 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[680c69cf-3f20-43f1-8fa0-4c93e119f06f]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1a39da17-401f-43d1-a0a0-8c7a3cc79424 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.3c146b23-763d-44d8-a150-69cf8789697c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:28 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.3c146b23-763d-44d8-a150-69cf8789697c Sep 23 15:29:28 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:28 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1a39da17-401f-43d1-a0a0-8c7a3cc79424 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.3c146b23-763d-44d8-a150-69cf8789697c" returned: 0 in 0.398s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:28 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.remotefs [None req-1a39da17-401f-43d1-a0a0-8c7a3cc79424 tempest-ProjectMemberTests-607392192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba899c79-adf1-4404-858a-ee70d738dcf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86064) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 15:29:28 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8951e6-329b-4ae2-bb23-53b2dbe7d6d3]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:28 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1a39da17-401f-43d1-a0a0-8c7a3cc79424 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:28 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2 Sep 23 15:29:28 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:29 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1a39da17-401f-43d1-a0a0-8c7a3cc79424 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2" returned: 0 in 0.400s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1a39da17-401f-43d1-a0a0-8c7a3cc79424 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.3c146b23-763d-44d8-a150-69cf8789697c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:29 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.3c146b23-763d-44d8-a150-69cf8789697c Sep 23 15:29:29 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:29 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1a39da17-401f-43d1-a0a0-8c7a3cc79424 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.3c146b23-763d-44d8-a150-69cf8789697c" returned: 0 in 0.382s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1a39da17-401f-43d1-a0a0-8c7a3cc79424 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.3c146b23-763d-44d8-a150-69cf8789697c {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:29 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.3c146b23-763d-44d8-a150-69cf8789697c Sep 23 15:29:29 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:29 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:29 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1a39da17-401f-43d1-a0a0-8c7a3cc79424 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2.3c146b23-763d-44d8-a150-69cf8789697c" returned: 0 in 0.251s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1a39da17-401f-43d1-a0a0-8c7a3cc79424 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-3c146b23-763d-44d8-a150-69cf8789697c" released by "_delete_snapshot" :: held 1.541s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:29 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1a39da17-401f-43d1-a0a0-8c7a3cc79424 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-ba899c79-adf1-4404-858a-ee70d738dcf2" released by "delete_snapshot" :: held 1.567s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:29 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-1a39da17-401f-43d1-a0a0-8c7a3cc79424 tempest-ProjectMemberTests-607392192 None] Created reservations ['e6a0324a-8270-4100-be70-a306d25cc696', '8ce69b9e-2308-423f-b5a3-84437046bb3f', 'f0d87597-9058-4b61-ba9a-114269203cb1', '6098bebf-45ad-466a-b266-f656b9162118'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:29:29 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-1a39da17-401f-43d1-a0a0-8c7a3cc79424 tempest-ProjectMemberTests-607392192 None] Delete snapshot completed successfully. Sep 23 15:29:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1a39da17-401f-43d1-a0a0-8c7a3cc79424 tempest-ProjectMemberTests-607392192 None] Lock "cinder-3c146b23-763d-44d8-a150-69cf8789697c-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1aa1250c-5505-4031-bfc5-b65f21dfc479 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-ba899c79-adf1-4404-858a-ee70d738dcf2-delete_volume" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1aa1250c-5505-4031-bfc5-b65f21dfc479 tempest-ProjectMemberTests-607392192 None] Lock "cinder-ba899c79-adf1-4404-858a-ee70d738dcf2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1aa1250c-5505-4031-bfc5-b65f21dfc479 tempest-ProjectMemberTests-607392192 None] Acquiring lock "cinder-quobyte-ba899c79-adf1-4404-858a-ee70d738dcf2" by "delete_volume" {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 15:29:30 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1aa1250c-5505-4031-bfc5-b65f21dfc479 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-ba899c79-adf1-4404-858a-ee70d738dcf2" acquired by "delete_volume" :: waited 0.016s {{(pid=86064) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 15:29:30 devstack cinder-volume[86064]: DEBUG oslo.privsep.daemon [-] privsep: reply[188c58be-932f-4d99-bf92-241c19597408]: (4, 'qcow2') {{(pid=87052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 15:29:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1aa1250c-5505-4031-bfc5-b65f21dfc479 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:30 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2 Sep 23 15:29:30 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:30 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1aa1250c-5505-4031-bfc5-b65f21dfc479 tempest-ProjectMemberTests-607392192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2" returned: 0 in 0.373s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:30 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1aa1250c-5505-4031-bfc5-b65f21dfc479 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2 {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:30 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2 Sep 23 15:29:30 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:31 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1aa1250c-5505-4031-bfc5-b65f21dfc479 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df/volume-ba899c79-adf1-4404-858a-ee70d738dcf2" returned: 0 in 0.267s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1aa1250c-5505-4031-bfc5-b65f21dfc479 tempest-ProjectMemberTests-607392192 None] Lock "cinder-quobyte-ba899c79-adf1-4404-858a-ee70d738dcf2" released by "delete_volume" :: held 0.731s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:31 devstack cinder-volume[86064]: DEBUG cinder.quota [None req-1aa1250c-5505-4031-bfc5-b65f21dfc479 tempest-ProjectMemberTests-607392192 None] Created reservations ['3a402f18-e51e-4e42-983d-51de4854779f', '34817441-5c4f-42f9-8266-0b89246adc33', '7c3f0c9e-a967-4b35-a84a-06c2703d5ccf', '0749291a-7a78-4b47-b7e2-76c70c98e6a4'] {{(pid=86064) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 15:29:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1aa1250c-5505-4031-bfc5-b65f21dfc479 tempest-ProjectMemberTests-607392192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1aa1250c-5505-4031-bfc5-b65f21dfc479 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1aa1250c-5505-4031-bfc5-b65f21dfc479 tempest-ProjectMemberTests-607392192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:29:31 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-1aa1250c-5505-4031-bfc5-b65f21dfc479 tempest-ProjectMemberTests-607392192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:29:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-1aa1250c-5505-4031-bfc5-b65f21dfc479 tempest-ProjectMemberTests-607392192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1aa1250c-5505-4031-bfc5-b65f21dfc479 tempest-ProjectMemberTests-607392192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:31 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:29:31 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:31 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:31 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-1aa1250c-5505-4031-bfc5-b65f21dfc479 tempest-ProjectMemberTests-607392192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.261s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:31 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-1aa1250c-5505-4031-bfc5-b65f21dfc479 tempest-ProjectMemberTests-607392192 None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:29:31 devstack cinder-volume[86064]: INFO cinder.volume.manager [None req-1aa1250c-5505-4031-bfc5-b65f21dfc479 tempest-ProjectMemberTests-607392192 None] Deleted volume successfully. Sep 23 15:29:31 devstack cinder-volume[86064]: DEBUG cinder.coordination [None req-1aa1250c-5505-4031-bfc5-b65f21dfc479 tempest-ProjectMemberTests-607392192 None] Lock "cinder-ba899c79-adf1-4404-858a-ee70d738dcf2-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86064) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 15:29:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:29:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 15:29:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 15:29:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8': None} {{(pid=86064) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 15:29:36 devstack cinder-volume[86064]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d507a5e-5b19-4e59-9532-a13c62d830f8'] {{(pid=86064) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 15:29:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.lockutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86064) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 15:29:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 15:29:36 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df Sep 23 15:29:36 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 15:29:36 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Sep 23 15:29:36 devstack cinder-volume[86064]: DEBUG oslo_concurrency.processutils [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecb64a7272edb94384a600a6366b42df" returned: 0 in 0.275s {{(pid=86064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 15:29:36 devstack cinder-volume[86064]: DEBUG cinder.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Notifying Schedulers of capabilities ... {{(pid=86064) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 15:29:36 devstack cinder-volume[86064]: DEBUG oslo_service.periodic_task [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] Running periodic task VolumeManager._thread_info {{(pid=86064) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 15:29:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread count: 28 {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 15:29:36 devstack cinder-volume[86064]: DEBUG cinder.volume.manager [None req-fb6dff4f-dc02-4529-bf82-f77edbaa8fca None None] thread info: [<_MainThread(MainThread, started 136352049426560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86064) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 15:29:41 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=90,cinder:UPDATE=115,cinder:INSERT=38,cinder:DELETE=5 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 15:29:41 devstack cinder-volume[86064]: DEBUG dbcounter [-] [86064] Writing DB stats cinder:SELECT=95,cinder:UPDATE=127,cinder:INSERT=30,cinder:DELETE=14 {{(pid=86064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}